Skip to content

WIP: JSON/Variant experiments#8156

Draft
AdamGS wants to merge 2 commits into
developfrom
adamg/json-to-variant
Draft

WIP: JSON/Variant experiments#8156
AdamGS wants to merge 2 commits into
developfrom
adamg/json-to-variant

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 29, 2026

Summary

Closes: #000

Testing

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 29, 2026 •
edited
Loading

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
❌ 1 regressed benchmark
✅ 1264 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_varbinview_canonical_into[(100, 100)] 273.1 µs 307.8 µs -11.27%
⚡ Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 225.4 µs 188.1 µs +19.84%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing adamg/json-to-variant (70c91be) with develop (30103b8)

Open in CodSpeed

@AdamGS AdamGS force-pushed the adamg/json-to-variant branch 2 times, most recently from d23ccd1 to 078ea95 Compare May 29, 2026 14:36
@AdamGS
some stuff
ebbb563 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/json-to-variant branch from 078ea95 to ebbb563 Compare May 29, 2026 14:54
@AdamGS
binary compression
70c91be 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label May 29, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 29, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 70c91be 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.907x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.907x ➖, 5↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚀 102178276 121282428 0.84
polarsignals_q01/datafusion:vortex-file-compressed 259540317 281710387 0.92
polarsignals_q02/datafusion:vortex-file-compressed 🚀 22030446 24587194 0.90
polarsignals_q03/datafusion:vortex-file-compressed 281717458 272984068 1.03
polarsignals_q04/datafusion:vortex-file-compressed 🚀 10305430 12538770 0.82
polarsignals_q05/datafusion:vortex-file-compressed 🚀 13961680 15712601 0.89
polarsignals_q06/datafusion:vortex-file-compressed 17562991 18601432 0.94
polarsignals_q07/datafusion:vortex-file-compressed 12810050 14134905 0.91
polarsignals_q08/datafusion:vortex-file-compressed 397737753 399778821 0.99
polarsignals_q09/datafusion:vortex-file-compressed 🚀 10088819 11940542 0.84
File Size Changes (1 files changed, -0.5% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.41 MB 685.83 MB 3.59 MB -0.5%

Totals:

  • vortex-file-compressed: 689.41 MB → 685.83 MB (-0.5%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.9%
Engines: DataFusion No clear signal (+3.1%, low confidence) · DuckDB No clear signal (-16.0%, environment too noisy confidence)
Vortex (geomean): 1.031x ➖
Parquet (geomean): 1.108x ❌
Shifts: Parquet (control) +10.8% · Median polish +1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5185081 4966621 1.04
fineweb_q01/datafusion:vortex-file-compressed 19589586 21156773 0.93
fineweb_q02/datafusion:vortex-file-compressed 22527016 22473573 1.00
fineweb_q03/datafusion:vortex-file-compressed 73789613 79715124 0.93
fineweb_q04/datafusion:vortex-file-compressed 229882901 229944358 1.00
fineweb_q05/datafusion:vortex-file-compressed 216695799 216633430 1.00
fineweb_q06/datafusion:vortex-file-compressed 52937627 50482449 1.05
fineweb_q07/datafusion:vortex-file-compressed 55482143 58117897 0.95
fineweb_q08/datafusion:vortex-file-compressed 22007370 21275919 1.03
datafusion / vortex-compact (1.101x ❌, 1↑ 4↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6091121 5418148 1.12
fineweb_q01/datafusion:vortex-compact 🚨 99762290 88962010 1.12
fineweb_q02/datafusion:vortex-compact 🚀 103884064 115680221 0.90
fineweb_q03/datafusion:vortex-compact 875395890 866736892 1.01
fineweb_q04/datafusion:vortex-compact 924371638 914874275 1.01
fineweb_q05/datafusion:vortex-compact 826829966 826551371 1.00
fineweb_q06/datafusion:vortex-compact 478226507 466890030 1.02
fineweb_q07/datafusion:vortex-compact 🚨 655789940 476760210 1.38
fineweb_q08/datafusion:vortex-compact 🚨 32350588 22096421 1.46
datafusion / parquet (1.013x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6562666 6657802 0.99
fineweb_q01/datafusion:parquet 286240321 293799547 0.97
fineweb_q02/datafusion:parquet 293751901 298150865 0.99
fineweb_q03/datafusion:parquet 297173924 275257203 1.08
fineweb_q04/datafusion:parquet 308519744 300733950 1.03
fineweb_q05/datafusion:parquet 295623864 302697782 0.98
fineweb_q06/datafusion:parquet 295045327 286477897 1.03
fineweb_q07/datafusion:parquet 290773373 280608388 1.04
fineweb_q08/datafusion:parquet 283840492 274870131 1.03
duckdb / vortex-file-compressed (1.025x ➖, 0↑ 1↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3910639 3419530 1.14
fineweb_q01/duckdb:vortex-file-compressed 22143919 22646916 0.98
fineweb_q02/duckdb:vortex-file-compressed 22933134 23599671 0.97
fineweb_q03/duckdb:vortex-file-compressed 117567810 116415741 1.01
fineweb_q04/duckdb:vortex-file-compressed 226999470 221748878 1.02
fineweb_q05/duckdb:vortex-file-compressed 214373726 209732374 1.02
fineweb_q06/duckdb:vortex-file-compressed 52355934 52052869 1.01
fineweb_q07/duckdb:vortex-file-compressed 58585648 53630217 1.09
fineweb_q08/duckdb:vortex-file-compressed 22474107 22763790 0.99
duckdb / vortex-compact (1.009x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4264497 4131840 1.03
fineweb_q01/duckdb:vortex-compact 109131719 105608908 1.03
fineweb_q02/duckdb:vortex-compact 109544865 110663562 0.99
fineweb_q03/duckdb:vortex-compact 870964494 858283544 1.01
fineweb_q04/duckdb:vortex-compact 910069129 892263930 1.02
fineweb_q05/duckdb:vortex-compact 810752347 801510038 1.01
fineweb_q06/duckdb:vortex-compact 464083337 455869374 1.02
fineweb_q07/duckdb:vortex-compact 476350479 478112716 1.00
fineweb_q08/duckdb:vortex-compact 19148737 19732309 0.97
duckdb / parquet (1.211x ❌, 0↑ 5↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 41347431 30300740 1.36
fineweb_q01/duckdb:parquet 🚨 121799115 90000528 1.35
fineweb_q02/duckdb:parquet 🚨 121564458 86159671 1.41
fineweb_q03/duckdb:parquet 🚨 462386632 317533590 1.46
fineweb_q04/duckdb:parquet 🚨 590874147 448945552 1.32
fineweb_q05/duckdb:parquet 439736467 415356927 1.06
fineweb_q06/duckdb:parquet 205725214 203618541 1.01
fineweb_q07/duckdb:parquet 217033727 216718865 1.00
fineweb_q08/duckdb:parquet 33756298 32328288 1.04

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +12.4% +16.0% -3.1% +47.2% ➖ noise
0 datafusion:vortex-file-compressed +4.4% +16.0% -10.0% +51.7% ➖ noise
0 duckdb:vortex-compact +3.2% +16.0% -11.0% +45.9% ➖ noise
0 duckdb:vortex-file-compressed +14.4% +16.0% -1.4% +69.7% ➖ noise
1 datafusion:vortex-compact +12.1% +14.8% -2.3% +22.6% ➖ noise
1 datafusion:vortex-file-compressed -7.4% +14.8% -19.4% +35.7% ➖ noise
1 duckdb:vortex-compact +3.3% +14.8% -10.0% +22.6% ➖ noise
1 duckdb:vortex-file-compressed -2.2% +14.8% -14.8% +66.8% ➖ noise
2 datafusion:vortex-compact -10.2% +17.9% -23.8% +22.6% ✅ faster
2 datafusion:vortex-file-compressed +0.2% +17.9% -15.0% +22.6% ➖ noise
2 duckdb:vortex-compact -1.0% +17.9% -16.0% +22.6% ➖ noise
2 duckdb:vortex-file-compressed -2.8% +17.9% -17.6% +22.6% ➖ noise
3 datafusion:vortex-compact +1.0% +25.4% -19.4% +22.6% ✅ faster
3 datafusion:vortex-file-compressed -7.4% +25.4% -26.2% +35.0% ✅ faster
3 duckdb:vortex-compact +1.5% +25.4% -19.1% +22.6% ✅ faster
3 duckdb:vortex-file-compressed +1.0% +25.4% -19.5% +29.0% ➖ noise
4 datafusion:vortex-compact +1.0% +16.2% -13.0% +22.6% ➖ noise
4 datafusion:vortex-file-compressed -0.0% +16.2% -14.0% +22.6% ➖ noise
4 duckdb:vortex-compact +2.0% +16.2% -12.2% +22.6% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +16.2% -11.9% +22.6% ➖ noise
5 datafusion:vortex-compact +0.0% +1.7% -1.6% +22.6% ➖ noise
5 datafusion:vortex-file-compressed +0.0% +1.7% -1.6% +22.6% ➖ noise
5 duckdb:vortex-compact +1.2% +1.7% -0.5% +22.6% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +1.7% +0.5% +22.6% ➖ noise
6 datafusion:vortex-compact +2.4% +2.0% +0.4% +22.6% ➖ noise
6 datafusion:vortex-file-compressed +4.9% +2.0% +2.8% +22.6% ➖ noise
6 duckdb:vortex-compact +1.8% +2.0% -0.2% +22.6% ➖ noise
6 duckdb:vortex-file-compressed +0.6% +2.0% -1.4% +22.6% ➖ noise
7 datafusion:vortex-compact +37.6% +1.9% +35.0% +22.6% 🚨 regression
7 datafusion:vortex-file-compressed -4.5% +1.9% -6.3% +22.6% ➖ noise
7 duckdb:vortex-compact -0.4% +1.9% -2.2% +22.6% ➖ noise
7 duckdb:vortex-file-compressed +9.2% +1.9% +7.2% +22.6% ➖ noise
8 datafusion:vortex-compact +46.4% +3.8% +41.0% +28.0% 🚨 regression
8 datafusion:vortex-file-compressed +3.4% +3.8% -0.4% +22.6% ➖ noise
8 duckdb:vortex-compact -3.0% +3.8% -6.5% +22.6% ➖ noise
8 duckdb:vortex-file-compressed -1.3% +3.8% -4.9% +22.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-2.5%, environment too noisy confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50918338 50336640 1.01
tpch_q02/datafusion:vortex-file-compressed 22354829 22654814 0.99
tpch_q03/datafusion:vortex-file-compressed 27255576 28061125 0.97
tpch_q04/datafusion:vortex-file-compressed 20418675 20956261 0.97
tpch_q05/datafusion:vortex-file-compressed 48033695 47656339 1.01
tpch_q06/datafusion:vortex-file-compressed 11089570 10967199 1.01
tpch_q07/datafusion:vortex-file-compressed 55091817 54072682 1.02
tpch_q08/datafusion:vortex-file-compressed 40426669 40514399 1.00
tpch_q09/datafusion:vortex-file-compressed 51900621 52221544 0.99
tpch_q10/datafusion:vortex-file-compressed 39308637 38873628 1.01
tpch_q11/datafusion:vortex-file-compressed 15976932 16667655 0.96
tpch_q12/datafusion:vortex-file-compressed 24258437 24580064 0.99
tpch_q13/datafusion:vortex-file-compressed 25032130 24619042 1.02
tpch_q14/datafusion:vortex-file-compressed 15507851 16256298 0.95
tpch_q15/datafusion:vortex-file-compressed 24404387 24973512 0.98
tpch_q16/datafusion:vortex-file-compressed 20028635 20604281 0.97
tpch_q17/datafusion:vortex-file-compressed 70308099 69678707 1.01
tpch_q18/datafusion:vortex-file-compressed 82173709 80946339 1.02
tpch_q19/datafusion:vortex-file-compressed 21182565 21803057 0.97
tpch_q20/datafusion:vortex-file-compressed 30103859 29876146 1.01
tpch_q21/datafusion:vortex-file-compressed 72008448 73547313 0.98
tpch_q22/datafusion:vortex-file-compressed 12263426 12598866 0.97
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 55525864 56344474 0.99
tpch_q02/datafusion:vortex-compact 24919824 26108301 0.95
tpch_q03/datafusion:vortex-compact 28785664 28915564 1.00
tpch_q04/datafusion:vortex-compact 22410494 22464785 1.00
tpch_q05/datafusion:vortex-compact 50514136 51952469 0.97
tpch_q06/datafusion:vortex-compact 12658268 13120941 0.96
tpch_q07/datafusion:vortex-compact 58783829 58558736 1.00
tpch_q08/datafusion:vortex-compact 43323698 43208572 1.00
tpch_q09/datafusion:vortex-compact 55273666 55536545 1.00
tpch_q10/datafusion:vortex-compact 45075841 44680270 1.01
tpch_q11/datafusion:vortex-compact 16931312 17428715 0.97
tpch_q12/datafusion:vortex-compact 31239562 31038100 1.01
tpch_q13/datafusion:vortex-compact 32070858 31678718 1.01
tpch_q14/datafusion:vortex-compact 19161405 18865183 1.02
tpch_q15/datafusion:vortex-compact 31089275 31007730 1.00
tpch_q16/datafusion:vortex-compact 24399594 24653182 0.99
tpch_q17/datafusion:vortex-compact 72009770 70548655 1.02
tpch_q18/datafusion:vortex-compact 83542741 84336939 0.99
tpch_q19/datafusion:vortex-compact 30981551 31300460 0.99
tpch_q20/datafusion:vortex-compact 34419551 35045673 0.98
tpch_q21/datafusion:vortex-compact 76737847 75656007 1.01
tpch_q22/datafusion:vortex-compact 12282425 12757076 0.96
datafusion / parquet (0.995x ➖, 1↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 97389578 96162378 1.01
tpch_q02/datafusion:parquet 62153398 61684899 1.01
tpch_q03/datafusion:parquet 73140852 72147417 1.01
tpch_q04/datafusion:parquet 42987140 43313214 0.99
tpch_q05/datafusion:parquet 92935096 94489096 0.98
tpch_q06/datafusion:parquet 42152060 41496895 1.02
tpch_q07/datafusion:parquet 104613211 103525216 1.01
tpch_q08/datafusion:parquet 92539810 92783572 1.00
tpch_q09/datafusion:parquet 122664572 129447816 0.95
tpch_q10/datafusion:parquet 108792807 110746553 0.98
tpch_q11/datafusion:parquet 40160098 40339349 1.00
tpch_q12/datafusion:parquet 85209236 83310279 1.02
tpch_q13/datafusion:parquet 202207796 198955011 1.02
tpch_q14/datafusion:parquet 47499418 44699315 1.06
tpch_q15/datafusion:parquet 57986919 59795132 0.97
tpch_q16/datafusion:parquet 40381392 40036917 1.01
tpch_q17/datafusion:parquet 126265894 134777450 0.94
tpch_q18/datafusion:parquet 163350249 162936417 1.00
tpch_q19/datafusion:parquet 🚀 69120082 77801349 0.89
tpch_q20/datafusion:parquet 70279599 66076597 1.06
tpch_q21/datafusion:parquet 137074748 134181394 1.02
tpch_q22/datafusion:parquet 30603475 31942660 0.96
datafusion / arrow (1.007x ➖, 0↑ 1↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54050652 54613425 0.99
tpch_q02/datafusion:arrow 18639250 19284570 0.97
tpch_q03/datafusion:arrow 29770459 29924085 0.99
tpch_q04/datafusion:arrow 26092867 24614467 1.06
tpch_q05/datafusion:arrow 🚨 83730774 74105933 1.13
tpch_q06/datafusion:arrow 20304885 19018946 1.07
tpch_q07/datafusion:arrow 103863337 100805153 1.03
tpch_q08/datafusion:arrow 44017625 42980328 1.02
tpch_q09/datafusion:arrow 64747166 67517797 0.96
tpch_q10/datafusion:arrow 46951974 48958978 0.96
tpch_q11/datafusion:arrow 9070018 9260177 0.98
tpch_q12/datafusion:arrow 50432285 51615722 0.98
tpch_q13/datafusion:arrow 46610850 47236359 0.99
tpch_q14/datafusion:arrow 21361202 20987915 1.02
tpch_q15/datafusion:arrow 41904549 41122958 1.02
tpch_q16/datafusion:arrow 18588827 18812649 0.99
tpch_q17/datafusion:arrow 66761321 67647200 0.99
tpch_q18/datafusion:arrow 134072176 131952081 1.02
tpch_q19/datafusion:arrow 35097726 34323075 1.02
tpch_q20/datafusion:arrow 34526055 33279932 1.04
tpch_q21/datafusion:arrow 149476818 150765493 0.99
tpch_q22/datafusion:arrow 17052285 17595838 0.97
duckdb / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 30954439 30983347 1.00
tpch_q02/duckdb:vortex-file-compressed 24952760 24936455 1.00
tpch_q03/duckdb:vortex-file-compressed 32369889 32536634 0.99
tpch_q04/duckdb:vortex-file-compressed 28619012 28405890 1.01
tpch_q05/duckdb:vortex-file-compressed 37262563 36819429 1.01
tpch_q06/duckdb:vortex-file-compressed 8166303 8261970 0.99
tpch_q07/duckdb:vortex-file-compressed 34581822 34722624 1.00
tpch_q08/duckdb:vortex-file-compressed 37189722 37220622 1.00
tpch_q09/duckdb:vortex-file-compressed 56796679 57466602 0.99
tpch_q10/duckdb:vortex-file-compressed 41036050 41227547 1.00
tpch_q11/duckdb:vortex-file-compressed 14924985 14473791 1.03
tpch_q12/duckdb:vortex-file-compressed 22499209 22519811 1.00
tpch_q13/duckdb:vortex-file-compressed 40845996 40238118 1.02
tpch_q14/duckdb:vortex-file-compressed 21262522 21645919 0.98
tpch_q15/duckdb:vortex-file-compressed 17007453 17561740 0.97
tpch_q16/duckdb:vortex-file-compressed 29484426 29876657 0.99
tpch_q17/duckdb:vortex-file-compressed 23949093 24416884 0.98
tpch_q18/duckdb:vortex-file-compressed 52650653 52696632 1.00
tpch_q19/duckdb:vortex-file-compressed 29151206 28931457 1.01
tpch_q20/duckdb:vortex-file-compressed 31626789 31936975 0.99
tpch_q21/duckdb:vortex-file-compressed 99134596 99582635 1.00
tpch_q22/duckdb:vortex-file-compressed 16966411 17126805 0.99
duckdb / vortex-compact (1.002x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38485764 38126179 1.01
tpch_q02/duckdb:vortex-compact 33683294 32765549 1.03
tpch_q03/duckdb:vortex-compact 33973245 34380988 0.99
tpch_q04/duckdb:vortex-compact 31608116 31033832 1.02
tpch_q05/duckdb:vortex-compact 41014342 41093217 1.00
tpch_q06/duckdb:vortex-compact 10998929 11267921 0.98
tpch_q07/duckdb:vortex-compact 41631026 41088967 1.01
tpch_q08/duckdb:vortex-compact 41843598 42006491 1.00
tpch_q09/duckdb:vortex-compact 65563487 64604137 1.01
tpch_q10/duckdb:vortex-compact 44857955 45875469 0.98
tpch_q11/duckdb:vortex-compact 18613195 18259573 1.02
tpch_q12/duckdb:vortex-compact 29376133 29903631 0.98
tpch_q13/duckdb:vortex-compact 46781548 46224602 1.01
tpch_q14/duckdb:vortex-compact 26354345 25683413 1.03
tpch_q15/duckdb:vortex-compact 20088797 19749758 1.02
tpch_q16/duckdb:vortex-compact 32722256 33132631 0.99
tpch_q17/duckdb:vortex-compact 28752361 28275471 1.02
tpch_q18/duckdb:vortex-compact 53233310 52740598 1.01
tpch_q19/duckdb:vortex-compact 32631452 33522603 0.97
tpch_q20/duckdb:vortex-compact 39671226 40571516 0.98
tpch_q21/duckdb:vortex-compact 102301232 102427916 1.00
tpch_q22/duckdb:vortex-compact 17963986 17935513 1.00
duckdb / parquet (1.024x ➖, 0↑ 2↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76357530 79922158 0.96
tpch_q02/duckdb:parquet 39114253 39180522 1.00
tpch_q03/duckdb:parquet 69849734 70391144 0.99
tpch_q04/duckdb:parquet 49512023 49084238 1.01
tpch_q05/duckdb:parquet 67493222 67670206 1.00
tpch_q06/duckdb:parquet 22163279 22850600 0.97
tpch_q07/duckdb:parquet 75886175 76222613 1.00
tpch_q08/duckdb:parquet 🚨 92123450 82088419 1.12
tpch_q09/duckdb:parquet 141312704 133293873 1.06
tpch_q10/duckdb:parquet 132361583 132591294 1.00
tpch_q11/duckdb:parquet 22192650 22161944 1.00
tpch_q12/duckdb:parquet 46785247 46627200 1.00
tpch_q13/duckdb:parquet 249891581 252922160 0.99
tpch_q14/duckdb:parquet 50492852 50705452 1.00
tpch_q15/duckdb:parquet 🚨 32105613 25954495 1.24
tpch_q16/duckdb:parquet 57285633 57917079 0.99
tpch_q17/duckdb:parquet 64524063 59651266 1.08
tpch_q18/duckdb:parquet 123379818 118336991 1.04
tpch_q19/duckdb:parquet 72190484 67826658 1.06
tpch_q20/duckdb:parquet 65490834 65102124 1.01
tpch_q21/duckdb:parquet 183693731 174128495 1.05
tpch_q22/duckdb:parquet 53475937 53273250 1.00
duckdb / duckdb (0.997x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 084f327 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17534588 17458109 1.00
tpch_q02/duckdb:duckdb 13918951 14328138 0.97
tpch_q03/duckdb:duckdb 22403959 22607547 0.99
tpch_q04/duckdb:duckdb 21884473 21122262 1.04
tpch_q05/duckdb:duckdb 23224147 22951312 1.01
tpch_q06/duckdb:duckdb 6892290 6994611 0.99
tpch_q07/duckdb:duckdb 25296164 25574579 0.99
tpch_q08/duckdb:duckdb 24222770 24415232 0.99
tpch_q09/duckdb:duckdb 57623988 56813633 1.01
tpch_q10/duckdb:duckdb 52169313 50733004 1.03
tpch_q11/duckdb:duckdb 7019308 7055469 0.99
tpch_q12/duckdb:duckdb 18042759 18792159 0.96
tpch_q13/duckdb:duckdb 39680471 39404008 1.01
tpch_q14/duckdb:duckdb 21559732 21456091 1.00
tpch_q15/duckdb:duckdb 14050124 13572879 1.04
tpch_q16/duckdb:duckdb 25890835 26354804 0.98
tpch_q17/duckdb:duckdb 16019531 16662293 0.96
tpch_q18/duckdb:duckdb 40593849 41030989 0.99
tpch_q19/duckdb:duckdb 31104163 31079780 1.00
tpch_q20/duckdb:duckdb 25064034 25279192 0.99
tpch_q21/duckdb:duckdb 61522084 61784230 1.00
tpch_q22/duckdb:duckdb 25280121 25364487 1.00

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -1.0% -1.6% +0.6% +19.0% ➖ noise
1 datafusion:vortex-compact -1.5% -1.6% +0.2% +17.5% ➖ noise
1 datafusion:vortex-file-compressed +1.2% -1.6% +2.8% +17.2% ➖ noise
1 duckdb:duckdb +0.4% -1.6% +2.1% +14.3% ➖ noise
1 duckdb:vortex-compact +0.9% -1.6% +2.6% +14.4% ➖ noise
1 duckdb:vortex-file-compressed -0.1% -1.6% +1.6% +17.4% ➖ noise
2 datafusion:arrow -3.3% +0.3% -3.6% +10.0% ➖ noise
2 datafusion:vortex-compact -4.6% +0.3% -4.8% +13.7% ➖ noise
2 datafusion:vortex-file-compressed -1.3% +0.3% -1.6% +10.0% ➖ noise
2 duckdb:duckdb -2.9% +0.3% -3.1% +10.0% ➖ noise
2 duckdb:vortex-compact +2.8% +0.3% +2.5% +13.7% ➖ noise
2 duckdb:vortex-file-compressed +0.1% +0.3% -0.2% +10.0% ➖ noise
3 datafusion:arrow -0.5% +0.3% -0.8% +10.0% ➖ noise
3 datafusion:vortex-compact -0.4% +0.3% -0.7% +12.6% ➖ noise
3 datafusion:vortex-file-compressed -2.9% +0.3% -3.2% +15.1% ➖ noise
3 duckdb:duckdb -0.9% +0.3% -1.2% +10.0% ➖ noise
3 duckdb:vortex-compact -1.2% +0.3% -1.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% +0.3% -0.8% +10.7% ➖ noise
4 datafusion:arrow +6.0% +0.1% +5.9% +10.0% ➖ noise
4 datafusion:vortex-compact -0.2% +0.1% -0.3% +11.7% ➖ noise
4 datafusion:vortex-file-compressed -2.6% +0.1% -2.6% +18.2% ➖ noise
4 duckdb:duckdb +3.6% +0.1% +3.6% +10.0% ➖ noise
4 duckdb:vortex-compact +1.9% +0.1% +1.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.8% +0.1% +0.7% +10.0% ➖ noise
5 datafusion:arrow +13.0% -1.0% +14.1% +10.0% 🚨 regression
5 datafusion:vortex-compact -2.8% -1.0% -1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.8% -1.0% +1.8% +10.0% ➖ noise
5 duckdb:duckdb +1.2% -1.0% +2.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.2% -1.0% +0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% -1.0% +2.2% +10.0% ➖ noise
6 datafusion:arrow +6.8% -0.7% +7.6% +14.2% ➖ noise
6 datafusion:vortex-compact -3.5% -0.7% -2.8% +20.8% ➖ noise
6 datafusion:vortex-file-compressed +1.1% -0.7% +1.9% +22.4% ➖ noise
6 duckdb:duckdb -1.5% -0.7% -0.7% +14.8% ➖ noise
6 duckdb:vortex-compact -2.4% -0.7% -1.7% +21.1% ➖ noise
6 duckdb:vortex-file-compressed -1.2% -0.7% -0.4% +16.7% ➖ noise
7 datafusion:arrow +3.0% +0.3% +2.7% +11.1% ➖ noise
7 datafusion:vortex-compact +0.4% +0.3% +0.1% +10.1% ➖ noise
7 datafusion:vortex-file-compressed +1.9% +0.3% +1.6% +10.0% ➖ noise
7 duckdb:duckdb -1.1% +0.3% -1.4% +10.0% ➖ noise
7 duckdb:vortex-compact +1.3% +0.3% +1.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.4% +0.3% -0.7% +10.0% ➖ noise
8 datafusion:arrow +2.4% +5.8% -3.2% +10.0% ➖ noise
8 datafusion:vortex-compact +0.3% +5.8% -5.2% +10.2% ➖ noise
8 datafusion:vortex-file-compressed -0.2% +5.8% -5.7% +10.6% ➖ noise
8 duckdb:duckdb -0.8% +5.8% -6.2% +10.0% ➖ noise
8 duckdb:vortex-compact -0.4% +5.8% -5.8% +13.4% ➖ noise
8 duckdb:vortex-file-compressed -0.1% +5.8% -5.6% +11.5% ➖ noise
9 datafusion:arrow -4.1% +0.2% -4.3% +10.0% ➖ noise
9 datafusion:vortex-compact -0.5% +0.2% -0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.6% +0.2% -0.8% +10.0% ➖ noise
9 duckdb:duckdb +1.4% +0.2% +1.2% +10.0% ➖ noise
9 duckdb:vortex-compact +1.5% +0.2% +1.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.2% +0.2% -1.4% +10.7% ➖ noise
10 datafusion:arrow -4.1% -1.0% -3.2% +10.0% ➖ noise
10 datafusion:vortex-compact +0.9% -1.0% +1.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.1% -1.0% +2.1% +10.0% ➖ noise
10 duckdb:duckdb +2.8% -1.0% +3.8% +10.0% ➖ noise
10 duckdb:vortex-compact -2.2% -1.0% -1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.5% -1.0% +0.5% +10.0% ➖ noise
11 datafusion:arrow -2.1% -0.2% -1.9% +10.0% ➖ noise
11 datafusion:vortex-compact -2.9% -0.2% -2.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -4.1% -0.2% -4.0% +10.0% ➖ noise
11 duckdb:duckdb -0.5% -0.2% -0.4% +10.0% ➖ noise
11 duckdb:vortex-compact +1.9% -0.2% +2.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.1% -0.2% +3.3% +10.0% ➖ noise
12 datafusion:arrow -2.3% +1.3% -3.6% +18.8% ➖ noise
12 datafusion:vortex-compact +0.6% +1.3% -0.6% +15.1% ➖ noise
12 datafusion:vortex-file-compressed -1.3% +1.3% -2.6% +15.6% ➖ noise
12 duckdb:duckdb -4.0% +1.3% -5.2% +10.8% ➖ noise
12 duckdb:vortex-compact -1.8% +1.3% -3.0% +14.4% ➖ noise
12 duckdb:vortex-file-compressed -0.1% +1.3% -1.4% +17.7% ➖ noise
13 datafusion:arrow -1.3% +0.2% -1.5% +14.2% ➖ noise
13 datafusion:vortex-compact +1.2% +0.2% +1.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.7% +0.2% +1.5% +10.0% ➖ noise
13 duckdb:duckdb +0.7% +0.2% +0.5% +12.8% ➖ noise
13 duckdb:vortex-compact +1.2% +0.2% +1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.5% +0.2% +1.3% +10.0% ➖ noise
14 datafusion:arrow +1.8% +2.9% -1.1% +13.7% ➖ noise
14 datafusion:vortex-compact +1.6% +2.9% -1.3% +13.4% ➖ noise
14 datafusion:vortex-file-compressed -4.6% +2.9% -7.3% +11.0% ➖ noise
14 duckdb:duckdb +0.5% +2.9% -2.3% +10.0% ➖ noise
14 duckdb:vortex-compact +2.6% +2.9% -0.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.8% +2.9% -4.5% +14.9% ➖ noise
15 datafusion:arrow +1.9% +9.5% -7.0% +12.1% ➖ noise
15 datafusion:vortex-compact +0.3% +9.5% -8.5% +10.4% ➖ noise
15 datafusion:vortex-file-compressed -2.3% +9.5% -10.8% +13.0% ➖ noise
15 duckdb:duckdb +3.5% +9.5% -5.5% +10.6% ➖ noise
15 duckdb:vortex-compact +1.7% +9.5% -7.1% +10.4% ➖ noise
15 duckdb:vortex-file-compressed -3.2% +9.5% -11.6% +11.4% ✅ faster
16 datafusion:arrow -1.2% -0.1% -1.1% +10.0% ➖ noise
16 datafusion:vortex-compact -1.0% -0.1% -0.9% +10.5% ➖ noise
16 datafusion:vortex-file-compressed -2.8% -0.1% -2.7% +10.0% ➖ noise
16 duckdb:duckdb -1.8% -0.1% -1.6% +10.0% ➖ noise
16 duckdb:vortex-compact -1.2% -0.1% -1.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.3% -0.1% -1.2% +10.0% ➖ noise
17 datafusion:arrow -1.3% +0.7% -2.0% +10.1% ➖ noise
17 datafusion:vortex-compact +2.1% +0.7% +1.4% +11.7% ➖ noise
17 datafusion:vortex-file-compressed +0.9% +0.7% +0.2% +13.4% ➖ noise
17 duckdb:duckdb -3.9% +0.7% -4.5% +10.0% ➖ noise
17 duckdb:vortex-compact +1.7% +0.7% +1.0% +10.4% ➖ noise
17 duckdb:vortex-file-compressed -1.9% +0.7% -2.6% +14.9% ➖ noise
18 datafusion:arrow +1.6% +2.2% -0.6% +10.0% ➖ noise
18 datafusion:vortex-compact -0.9% +2.2% -3.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.5% +2.2% -0.7% +10.0% ➖ noise
18 duckdb:duckdb -1.1% +2.2% -3.2% +10.0% ➖ noise
18 duckdb:vortex-compact +0.9% +2.2% -1.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.1% +2.2% -2.3% +10.0% ➖ noise
19 datafusion:arrow +2.3% -2.8% +5.2% +21.8% ➖ noise
19 datafusion:vortex-compact -1.0% -2.8% +1.8% +16.8% ➖ noise
19 datafusion:vortex-file-compressed -2.8% -2.8% -0.1% +16.2% ➖ noise
19 duckdb:duckdb +0.1% -2.8% +2.9% +11.5% ➖ noise
19 duckdb:vortex-compact -2.7% -2.8% +0.1% +11.0% ➖ noise
19 duckdb:vortex-file-compressed +0.8% -2.8% +3.6% +11.9% ➖ noise
20 datafusion:arrow +3.7% +3.4% +0.3% +10.9% ➖ noise
20 datafusion:vortex-compact -1.8% +3.4% -5.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.8% +3.4% -2.6% +13.1% ➖ noise
20 duckdb:duckdb -0.9% +3.4% -4.1% +10.0% ➖ noise
20 duckdb:vortex-compact -2.2% +3.4% -5.5% +10.9% ➖ noise
20 duckdb:vortex-file-compressed -1.0% +3.4% -4.3% +10.0% ➖ noise
21 datafusion:arrow -0.9% +3.8% -4.5% +10.0% ➖ noise
21 datafusion:vortex-compact +1.4% +3.8% -2.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.1% +3.8% -5.7% +10.0% ➖ noise
21 duckdb:duckdb -0.4% +3.8% -4.1% +10.0% ➖ noise
21 duckdb:vortex-compact -0.1% +3.8% -3.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.4% +3.8% -4.1% +10.0% ➖ noise
22 datafusion:arrow -3.1% -1.9% -1.2% +10.0% ➖ noise
22 datafusion:vortex-compact -3.7% -1.9% -1.8% +11.3% ➖ noise
22 datafusion:vortex-file-compressed -2.7% -1.9% -0.7% +10.0% ➖ noise
22 duckdb:duckdb -0.3% -1.9% +1.6% +10.0% ➖ noise
22 duckdb:vortex-compact +0.2% -1.9% +2.1% +12.3% ➖ noise
22 duckdb:vortex-file-compressed -0.9% -1.9% +1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.985x ➖, 2↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27933494 29446263 0.95
tpcds_q02/datafusion:vortex-file-compressed 52293604 51186337 1.02
tpcds_q03/datafusion:vortex-file-compressed 16850146 16730480 1.01
tpcds_q04/datafusion:vortex-file-compressed 270849017 279376317 0.97
tpcds_q05/datafusion:vortex-file-compressed 46363488 45385859 1.02
tpcds_q06/datafusion:vortex-file-compressed 61458655 62329050 0.99
tpcds_q07/datafusion:vortex-file-compressed 44845783 45017310 1.00
tpcds_q08/datafusion:vortex-file-compressed 31782462 30681407 1.04
tpcds_q09/datafusion:vortex-file-compressed 42553225 42264465 1.01
tpcds_q10/datafusion:vortex-file-compressed 41459894 42606617 0.97
tpcds_q11/datafusion:vortex-file-compressed 140509633 145745966 0.96
tpcds_q12/datafusion:vortex-file-compressed 21068264 21811787 0.97
tpcds_q13/datafusion:vortex-file-compressed 48688496 50216946 0.97
tpcds_q14/datafusion:vortex-file-compressed 184151765 184484166 1.00
tpcds_q15/datafusion:vortex-file-compressed 29987853 29690590 1.01
tpcds_q16/datafusion:vortex-file-compressed 29576670 31044442 0.95
tpcds_q17/datafusion:vortex-file-compressed 70716512 68299336 1.04
tpcds_q18/datafusion:vortex-file-compressed 72438071 74636729 0.97
tpcds_q19/datafusion:vortex-file-compressed 22604662 23816756 0.95
tpcds_q20/datafusion:vortex-file-compressed 22606207 23858327 0.95
tpcds_q21/datafusion:vortex-file-compressed 38326019 38476724 1.00
tpcds_q22/datafusion:vortex-file-compressed 153038580 161285634 0.95
tpcds_q23/datafusion:vortex-file-compressed 166596125 161554783 1.03
tpcds_q24/datafusion:vortex-file-compressed 91621031 90039126 1.02
tpcds_q25/datafusion:vortex-file-compressed 71001896 71888860 0.99
tpcds_q26/datafusion:vortex-file-compressed 36096631 34998877 1.03
tpcds_q27/datafusion:vortex-file-compressed 114005343 113889361 1.00
tpcds_q28/datafusion:vortex-file-compressed 33796340 34555641 0.98
tpcds_q29/datafusion:vortex-file-compressed 65071677 67543980 0.96
tpcds_q30/datafusion:vortex-file-compressed 🚀 24252007 27493783 0.88
tpcds_q31/datafusion:vortex-file-compressed 82935037 81371327 1.02
tpcds_q32/datafusion:vortex-file-compressed 21251594 21695056 0.98
tpcds_q33/datafusion:vortex-file-compressed 30779642 31160715 0.99
tpcds_q34/datafusion:vortex-file-compressed 26091433 27841205 0.94
tpcds_q35/datafusion:vortex-file-compressed 49066443 50856356 0.96
tpcds_q36/datafusion:vortex-file-compressed 63396685 61435827 1.03
tpcds_q37/datafusion:vortex-file-compressed 26161629 26428205 0.99
tpcds_q38/datafusion:vortex-file-compressed 45355741 47223284 0.96
tpcds_q39/datafusion:vortex-file-compressed 111039207 116465511 0.95
tpcds_q40/datafusion:vortex-file-compressed 34440990 34849831 0.99
tpcds_q41/datafusion:vortex-file-compressed 17394098 17297434 1.01
tpcds_q42/datafusion:vortex-file-compressed 14687610 14585964 1.01
tpcds_q43/datafusion:vortex-file-compressed 20127391 19623915 1.03
tpcds_q44/datafusion:vortex-file-compressed 34320199 35472408 0.97
tpcds_q45/datafusion:vortex-file-compressed 31048917 30173855 1.03
tpcds_q46/datafusion:vortex-file-compressed 37936872 38085998 1.00
tpcds_q47/datafusion:vortex-file-compressed 141892201 143162442 0.99
tpcds_q48/datafusion:vortex-file-compressed 39249943 37803667 1.04
tpcds_q49/datafusion:vortex-file-compressed 61931556 60725029 1.02
tpcds_q50/datafusion:vortex-file-compressed 41000789 42165810 0.97
tpcds_q51/datafusion:vortex-file-compressed 99646564 98421671 1.01
tpcds_q52/datafusion:vortex-file-compressed 15907538 15359043 1.04
tpcds_q53/datafusion:vortex-file-compressed 23328438 23533685 0.99
tpcds_q54/datafusion:vortex-file-compressed 36009667 36959536 0.97
tpcds_q55/datafusion:vortex-file-compressed 14632793 14834236 0.99
tpcds_q56/datafusion:vortex-file-compressed 30447156 32391479 0.94
tpcds_q57/datafusion:vortex-file-compressed 113677990 115102219 0.99
tpcds_q58/datafusion:vortex-file-compressed 55612274 59872501 0.93
tpcds_q59/datafusion:vortex-file-compressed 58939610 59173188 1.00
tpcds_q60/datafusion:vortex-file-compressed 30796015 33389473 0.92
tpcds_q61/datafusion:vortex-file-compressed 42190862 43889169 0.96
tpcds_q62/datafusion:vortex-file-compressed 27315780 26081356 1.05
tpcds_q63/datafusion:vortex-file-compressed 23866550 23003959 1.04
tpcds_q64/datafusion:vortex-file-compressed 450085584 450266248 1.00
tpcds_q65/datafusion:vortex-file-compressed 45552764 42027590 1.08
tpcds_q66/datafusion:vortex-file-compressed 75881820 77157745 0.98
tpcds_q67/datafusion:vortex-file-compressed 158335585 159540911 0.99
tpcds_q68/datafusion:vortex-file-compressed 34118118 34696206 0.98
tpcds_q69/datafusion:vortex-file-compressed 38806114 40176427 0.97
tpcds_q70/datafusion:vortex-file-compressed 89340238 92328038 0.97
tpcds_q71/datafusion:vortex-file-compressed 24510032 24760072 0.99
tpcds_q72/datafusion:vortex-file-compressed 2439651509 2397901020 1.02
tpcds_q73/datafusion:vortex-file-compressed 24394897 24518026 0.99
tpcds_q74/datafusion:vortex-file-compressed 90904746 89027778 1.02
tpcds_q75/datafusion:vortex-file-compressed 113553677 113673660 1.00
tpcds_q76/datafusion:vortex-file-compressed 33065004 35259180 0.94
tpcds_q77/datafusion:vortex-file-compressed 47303126 43091264 1.10
tpcds_q78/datafusion:vortex-file-compressed 131267169 134524090 0.98
tpcds_q79/datafusion:vortex-file-compressed 29562582 30549764 0.97
tpcds_q80/datafusion:vortex-file-compressed 100522602 104345835 0.96
tpcds_q81/datafusion:vortex-file-compressed 25607934 25373090 1.01
tpcds_q82/datafusion:vortex-file-compressed 26296002 26588157 0.99
tpcds_q83/datafusion:vortex-file-compressed 36462296 37157717 0.98
tpcds_q84/datafusion:vortex-file-compressed 13670660 14217367 0.96
tpcds_q85/datafusion:vortex-file-compressed 95944793 99132247 0.97
tpcds_q86/datafusion:vortex-file-compressed 18441575 19188436 0.96
tpcds_q87/datafusion:vortex-file-compressed 46874274 47414885 0.99
tpcds_q88/datafusion:vortex-file-compressed 60584333 60244927 1.01
tpcds_q89/datafusion:vortex-file-compressed 26151826 28385478 0.92
tpcds_q90/datafusion:vortex-file-compressed 15383060 16016734 0.96
tpcds_q91/datafusion:vortex-file-compressed 19499419 20939581 0.93
tpcds_q92/datafusion:vortex-file-compressed 19228914 20281414 0.95
tpcds_q93/datafusion:vortex-file-compressed 35383914 36995235 0.96
tpcds_q94/datafusion:vortex-file-compressed 25827256 24766392 1.04
tpcds_q95/datafusion:vortex-file-compressed 66745222 66600219 1.00
tpcds_q96/datafusion:vortex-file-compressed 14354244 14933041 0.96
tpcds_q97/datafusion:vortex-file-compressed 33059297 35225813 0.94
tpcds_q98/datafusion:vortex-file-compressed 25302616 25735140 0.98
tpcds_q99/datafusion:vortex-file-compressed 🚀 31001750 35587642 0.87
datafusion / vortex-compact (0.987x ➖, 3↑ 2↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26778326 29006191 0.92
tpcds_q02/datafusion:vortex-compact 57731929 60331448 0.96
tpcds_q03/datafusion:vortex-compact 19980984 20250594 0.99
tpcds_q04/datafusion:vortex-compact 317008703 314016948 1.01
tpcds_q05/datafusion:vortex-compact 53653052 51740693 1.04
tpcds_q06/datafusion:vortex-compact 63948752 61064081 1.05
tpcds_q07/datafusion:vortex-compact 56988062 56064753 1.02
tpcds_q08/datafusion:vortex-compact 37952774 36569440 1.04
tpcds_q09/datafusion:vortex-compact 54405720 55211770 0.99
tpcds_q10/datafusion:vortex-compact 50796594 51688955 0.98
tpcds_q11/datafusion:vortex-compact 165062236 169969141 0.97
tpcds_q12/datafusion:vortex-compact 27979590 27927331 1.00
tpcds_q13/datafusion:vortex-compact 🚨 146376871 132174888 1.11
tpcds_q14/datafusion:vortex-compact 211276880 209665246 1.01
tpcds_q15/datafusion:vortex-compact 32351664 32239809 1.00
tpcds_q16/datafusion:vortex-compact 35547879 37585529 0.95
tpcds_q17/datafusion:vortex-compact 82050621 77353982 1.06
tpcds_q18/datafusion:vortex-compact 82875138 83253352 1.00
tpcds_q19/datafusion:vortex-compact 30999570 31284823 0.99
tpcds_q20/datafusion:vortex-compact 27588577 27327720 1.01
tpcds_q21/datafusion:vortex-compact 42654464 42421416 1.01
tpcds_q22/datafusion:vortex-compact 🚀 129190304 145581236 0.89
tpcds_q23/datafusion:vortex-compact 175622737 183376390 0.96
tpcds_q24/datafusion:vortex-compact 104146774 102656465 1.01
tpcds_q25/datafusion:vortex-compact 83900648 85319905 0.98
tpcds_q26/datafusion:vortex-compact 45853930 46878453 0.98
tpcds_q27/datafusion:vortex-compact 134354593 139618310 0.96
tpcds_q28/datafusion:vortex-compact 103479060 104375437 0.99
tpcds_q29/datafusion:vortex-compact 77701507 77687901 1.00
tpcds_q30/datafusion:vortex-compact 🚀 29015456 32671337 0.89
tpcds_q31/datafusion:vortex-compact 103175666 105952263 0.97
tpcds_q32/datafusion:vortex-compact 26523513 27234297 0.97
tpcds_q33/datafusion:vortex-compact 38448334 39401920 0.98
tpcds_q34/datafusion:vortex-compact 35402769 35454395 1.00
tpcds_q35/datafusion:vortex-compact 55800883 55188160 1.01
tpcds_q36/datafusion:vortex-compact 77660609 78403406 0.99
tpcds_q37/datafusion:vortex-compact 35682336 35878863 0.99
tpcds_q38/datafusion:vortex-compact 51089588 53439370 0.96
tpcds_q39/datafusion:vortex-compact 119891529 121426564 0.99
tpcds_q40/datafusion:vortex-compact 38243700 38358826 1.00
tpcds_q41/datafusion:vortex-compact 19643858 19933490 0.99
tpcds_q42/datafusion:vortex-compact 19101447 19309241 0.99
tpcds_q43/datafusion:vortex-compact 26062094 26873019 0.97
tpcds_q44/datafusion:vortex-compact 52167144 51316999 1.02
tpcds_q45/datafusion:vortex-compact 32214494 33396436 0.96
tpcds_q46/datafusion:vortex-compact 47118050 48133962 0.98
tpcds_q47/datafusion:vortex-compact 163619995 164116782 1.00
tpcds_q48/datafusion:vortex-compact 🚀 84767731 99661095 0.85
tpcds_q49/datafusion:vortex-compact 74428891 73094569 1.02
tpcds_q50/datafusion:vortex-compact 50280173 51194472 0.98
tpcds_q51/datafusion:vortex-compact 99940490 102357229 0.98
tpcds_q52/datafusion:vortex-compact 19457642 19521035 1.00
tpcds_q53/datafusion:vortex-compact 29142751 30912378 0.94
tpcds_q54/datafusion:vortex-compact 43355945 46945284 0.92
tpcds_q55/datafusion:vortex-compact 18994307 19010096 1.00
tpcds_q56/datafusion:vortex-compact 37445106 38535083 0.97
tpcds_q57/datafusion:vortex-compact 121557697 122352437 0.99
tpcds_q58/datafusion:vortex-compact 63703223 66751489 0.95
tpcds_q59/datafusion:vortex-compact 70431076 72002631 0.98
tpcds_q60/datafusion:vortex-compact 37889790 39216601 0.97
tpcds_q61/datafusion:vortex-compact 58707460 57497838 1.02
tpcds_q62/datafusion:vortex-compact 🚨 33274979 29985484 1.11
tpcds_q63/datafusion:vortex-compact 30357688 30278588 1.00
tpcds_q64/datafusion:vortex-compact 485401263 499823644 0.97
tpcds_q65/datafusion:vortex-compact 57116130 56152980 1.02
tpcds_q66/datafusion:vortex-compact 80502507 85616005 0.94
tpcds_q67/datafusion:vortex-compact 163992028 165745178 0.99
tpcds_q68/datafusion:vortex-compact 46198749 50306081 0.92
tpcds_q69/datafusion:vortex-compact 48949555 49730883 0.98
tpcds_q70/datafusion:vortex-compact 103589635 104155550 0.99
tpcds_q71/datafusion:vortex-compact 32322809 31731692 1.02
tpcds_q72/datafusion:vortex-compact 2460901261 2416375490 1.02
tpcds_q73/datafusion:vortex-compact 33921969 32943922 1.03
tpcds_q74/datafusion:vortex-compact 102165039 100949836 1.01
tpcds_q75/datafusion:vortex-compact 138122003 140165849 0.99
tpcds_q76/datafusion:vortex-compact 34875184 34893366 1.00
tpcds_q77/datafusion:vortex-compact 55521575 56606048 0.98
tpcds_q78/datafusion:vortex-compact 150041062 151276961 0.99
tpcds_q79/datafusion:vortex-compact 40673236 41254857 0.99
tpcds_q80/datafusion:vortex-compact 110324290 115664384 0.95
tpcds_q81/datafusion:vortex-compact 29714297 29882695 0.99
tpcds_q82/datafusion:vortex-compact 37153405 36704677 1.01
tpcds_q83/datafusion:vortex-compact 35618886 37911805 0.94
tpcds_q84/datafusion:vortex-compact 15760175 16463274 0.96
tpcds_q85/datafusion:vortex-compact 167108437 182666902 0.91
tpcds_q86/datafusion:vortex-compact 19930643 20428497 0.98
tpcds_q87/datafusion:vortex-compact 53624150 56704893 0.95
tpcds_q88/datafusion:vortex-compact 81523430 82881277 0.98
tpcds_q89/datafusion:vortex-compact 33045909 33563367 0.98
tpcds_q90/datafusion:vortex-compact 16062316 16564645 0.97
tpcds_q91/datafusion:vortex-compact 35478036 35209791 1.01
tpcds_q92/datafusion:vortex-compact 27064327 24733823 1.09
tpcds_q93/datafusion:vortex-compact 40866339 40609841 1.01
tpcds_q94/datafusion:vortex-compact 27589260 29256817 0.94
tpcds_q95/datafusion:vortex-compact 71318024 69169500 1.03
tpcds_q96/datafusion:vortex-compact 18802517 18255524 1.03
tpcds_q97/datafusion:vortex-compact 39873224 40295194 0.99
tpcds_q98/datafusion:vortex-compact 31415209 31372324 1.00
tpcds_q99/datafusion:vortex-compact 37076454 36072279 1.03
datafusion / parquet (0.995x ➖, 2↑ 2↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 31352008 34798024 0.90
tpcds_q02/datafusion:parquet 45202130 44444891 1.02
tpcds_q03/datafusion:parquet 13651029 13089471 1.04
tpcds_q04/datafusion:parquet 276053935 290296875 0.95
tpcds_q05/datafusion:parquet 42951747 46276118 0.93
tpcds_q06/datafusion:parquet 59951870 63908293 0.94
tpcds_q07/datafusion:parquet 82733907 80543616 1.03
tpcds_q08/datafusion:parquet 29973203 27592983 1.09
tpcds_q09/datafusion:parquet 🚨 53431850 46129214 1.16
tpcds_q10/datafusion:parquet 78332708 73882342 1.06
tpcds_q11/datafusion:parquet 158932560 157459135 1.01
tpcds_q12/datafusion:parquet 18604336 17321278 1.07
tpcds_q13/datafusion:parquet 78577291 82143176 0.96
tpcds_q14/datafusion:parquet 178790537 176079101 1.02
tpcds_q15/datafusion:parquet 22877899 23426304 0.98
tpcds_q16/datafusion:parquet 25613114 25812684 0.99
tpcds_q17/datafusion:parquet 65388958 69795800 0.94
tpcds_q18/datafusion:parquet 118503844 122623392 0.97
tpcds_q19/datafusion:parquet 23748521 23444887 1.01
tpcds_q20/datafusion:parquet 17056545 17483551 0.98
tpcds_q21/datafusion:parquet 20006658 19672342 1.02
tpcds_q22/datafusion:parquet 🚀 155231289 173610967 0.89
tpcds_q23/datafusion:parquet 160934963 158731099 1.01
tpcds_q24/datafusion:parquet 95507971 95134710 1.00
tpcds_q25/datafusion:parquet 68669451 68449764 1.00
tpcds_q26/datafusion:parquet 69049711 68771183 1.00
tpcds_q27/datafusion:parquet 159251168 156560098 1.02
tpcds_q28/datafusion:parquet 47932895 47106919 1.02
tpcds_q29/datafusion:parquet 70845862 69180145 1.02
tpcds_q30/datafusion:parquet 38074348 37497696 1.02
tpcds_q31/datafusion:parquet 68661848 68909467 1.00
tpcds_q32/datafusion:parquet 19160677 19332804 0.99
tpcds_q33/datafusion:parquet 27900007 28431635 0.98
tpcds_q34/datafusion:parquet 22039360 24443564 0.90
tpcds_q35/datafusion:parquet 77615471 75472929 1.03
tpcds_q36/datafusion:parquet 62623925 61844625 1.01
tpcds_q37/datafusion:parquet 20633627 20764024 0.99
tpcds_q38/datafusion:parquet 42179324 45468126 0.93
tpcds_q39/datafusion:parquet 79351248 85050880 0.93
tpcds_q40/datafusion:parquet 24861256 26375344 0.94
tpcds_q41/datafusion:parquet 14637381 14693729 1.00
tpcds_q42/datafusion:parquet 12246523 12501218 0.98
tpcds_q43/datafusion:parquet 19569841 18827953 1.04
tpcds_q44/datafusion:parquet 35209859 37153381 0.95
tpcds_q45/datafusion:parquet 30552639 30527153 1.00
tpcds_q46/datafusion:parquet 33658679 35652171 0.94
tpcds_q47/datafusion:parquet 132503092 134990452 0.98
tpcds_q48/datafusion:parquet 75813590 72338203 1.05
tpcds_q49/datafusion:parquet 57882184 57435985 1.01
tpcds_q50/datafusion:parquet 46463802 47817555 0.97
tpcds_q51/datafusion:parquet 88987734 90640288 0.98
tpcds_q52/datafusion:parquet 12317181 12557428 0.98
tpcds_q53/datafusion:parquet 18835844 18897296 1.00
tpcds_q54/datafusion:parquet 36960943 36139657 1.02
tpcds_q55/datafusion:parquet 12405172 11893515 1.04
tpcds_q56/datafusion:parquet 29221051 29037278 1.01
tpcds_q57/datafusion:parquet 🚀 99940203 111282841 0.90
tpcds_q58/datafusion:parquet 52393720 55185800 0.95
tpcds_q59/datafusion:parquet 59943550 61134868 0.98
tpcds_q60/datafusion:parquet 29546113 28427566 1.04
tpcds_q61/datafusion:parquet 44711118 45389911 0.99
tpcds_q62/datafusion:parquet 21083899 21317148 0.99
tpcds_q63/datafusion:parquet 18305055 19139847 0.96
tpcds_q64/datafusion:parquet 541941837 544095055 1.00
tpcds_q65/datafusion:parquet 38478256 40027051 0.96
tpcds_q66/datafusion:parquet 75400889 69013550 1.09
tpcds_q67/datafusion:parquet 157932363 155427375 1.02
tpcds_q68/datafusion:parquet 33727652 32981392 1.02
tpcds_q69/datafusion:parquet 69239729 70033739 0.99
tpcds_q70/datafusion:parquet 92529125 92793648 1.00
tpcds_q71/datafusion:parquet 23701797 22877385 1.04
tpcds_q72/datafusion:parquet 674412680 654058498 1.03
tpcds_q73/datafusion:parquet 22796393 21982837 1.04
tpcds_q74/datafusion:parquet 89130316 89099511 1.00
tpcds_q75/datafusion:parquet 105331226 104608556 1.01
tpcds_q76/datafusion:parquet 31486486 32370005 0.97
tpcds_q77/datafusion:parquet 40364408 40395606 1.00
tpcds_q78/datafusion:parquet 123107397 124423415 0.99
tpcds_q79/datafusion:parquet 27625481 27381821 1.01
tpcds_q80/datafusion:parquet 86268461 85760664 1.01
tpcds_q81/datafusion:parquet 32145352 33654535 0.96
tpcds_q82/datafusion:parquet 20055581 20859943 0.96
tpcds_q83/datafusion:parquet 38331399 38566111 0.99
tpcds_q84/datafusion:parquet 40130605 41398572 0.97
tpcds_q85/datafusion:parquet 156417599 161629550 0.97
tpcds_q86/datafusion:parquet 17750040 17957297 0.99
tpcds_q87/datafusion:parquet 45022495 46352442 0.97
tpcds_q88/datafusion:parquet 62349027 61646850 1.01
tpcds_q89/datafusion:parquet 24719278 22846562 1.08
tpcds_q90/datafusion:parquet 15703135 15869036 0.99
tpcds_q91/datafusion:parquet 61089958 61322258 1.00
tpcds_q92/datafusion:parquet 19796439 19769186 1.00
tpcds_q93/datafusion:parquet 33783744 35325904 0.96
tpcds_q94/datafusion:parquet 20839696 21568019 0.97
tpcds_q95/datafusion:parquet 62142170 63611753 0.98
tpcds_q96/datafusion:parquet 14173160 13440097 1.05
tpcds_q97/datafusion:parquet 32070294 34235559 0.94
tpcds_q98/datafusion:parquet 23713499 22624632 1.05
tpcds_q99/datafusion:parquet 🚨 37383809 33028544 1.13
duckdb / vortex-file-compressed (0.998x ➖, 1↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24952977 24593862 1.01
tpcds_q02/duckdb:vortex-file-compressed 35527366 34150187 1.04
tpcds_q03/duckdb:vortex-file-compressed 22351803 23198119 0.96
tpcds_q04/duckdb:vortex-file-compressed 96700507 95953199 1.01
tpcds_q05/duckdb:vortex-file-compressed 33806364 34990164 0.97
tpcds_q06/duckdb:vortex-file-compressed 34699329 35365128 0.98
tpcds_q07/duckdb:vortex-file-compressed 22453448 22432804 1.00
tpcds_q08/duckdb:vortex-file-compressed 29876787 29292119 1.02
tpcds_q09/duckdb:vortex-file-compressed 16758688 15742169 1.06
tpcds_q10/duckdb:vortex-file-compressed 40475521 39458620 1.03
tpcds_q11/duckdb:vortex-file-compressed 68145601 68477963 1.00
tpcds_q12/duckdb:vortex-file-compressed 18049156 17357431 1.04
tpcds_q13/duckdb:vortex-file-compressed 34805507 34488526 1.01
tpcds_q14/duckdb:vortex-file-compressed 98783174 99287146 0.99
tpcds_q15/duckdb:vortex-file-compressed 29826665 29769029 1.00
tpcds_q16/duckdb:vortex-file-compressed 27727994 27900797 0.99
tpcds_q17/duckdb:vortex-file-compressed 45517523 46399983 0.98
tpcds_q18/duckdb:vortex-file-compressed 39307358 40554008 0.97
tpcds_q19/duckdb:vortex-file-compressed 34662640 35687534 0.97
tpcds_q20/duckdb:vortex-file-compressed 18106563 18546942 0.98
tpcds_q21/duckdb:vortex-file-compressed 17786554 17444640 1.02
tpcds_q22/duckdb:vortex-file-compressed 78444833 83749798 0.94
tpcds_q23/duckdb:vortex-file-compressed 95810111 87604733 1.09
tpcds_q24/duckdb:vortex-file-compressed 49508289 49682249 1.00
tpcds_q25/duckdb:vortex-file-compressed 44930759 43247804 1.04
tpcds_q26/duckdb:vortex-file-compressed 20056151 19758338 1.02
tpcds_q27/duckdb:vortex-file-compressed 24298721 24251975 1.00
tpcds_q28/duckdb:vortex-file-compressed 13044304 12722844 1.03
tpcds_q29/duckdb:vortex-file-compressed 44521534 43970860 1.01
tpcds_q30/duckdb:vortex-file-compressed 27265194 26079315 1.05
tpcds_q31/duckdb:vortex-file-compressed 29699092 30934096 0.96
tpcds_q32/duckdb:vortex-file-compressed 14484312 14531938 1.00
tpcds_q33/duckdb:vortex-file-compressed 24875880 24780814 1.00
tpcds_q34/duckdb:vortex-file-compressed 🚀 26389636 30822833 0.86
tpcds_q35/duckdb:vortex-file-compressed 66633357 66199082 1.01
tpcds_q36/duckdb:vortex-file-compressed 25439206 24955794 1.02
tpcds_q37/duckdb:vortex-file-compressed 22282031 21386584 1.04
tpcds_q38/duckdb:vortex-file-compressed 38418648 38334454 1.00
tpcds_q39/duckdb:vortex-file-compressed 36971433 36663805 1.01
tpcds_q40/duckdb:vortex-file-compressed 21643818 20802252 1.04
tpcds_q41/duckdb:vortex-file-compressed 10812210 10638321 1.02
tpcds_q42/duckdb:vortex-file-compressed 14792068 13794590 1.07
tpcds_q43/duckdb:vortex-file-compressed 21956701 23050971 0.95
tpcds_q44/duckdb:vortex-file-compressed 21313239 22145856 0.96
tpcds_q45/duckdb:vortex-file-compressed 31185009 31566063 0.99
tpcds_q46/duckdb:vortex-file-compressed 30114826 31379577 0.96
tpcds_q47/duckdb:vortex-file-compressed 55961935 55815371 1.00
tpcds_q48/duckdb:vortex-file-compressed 30581738 31139593 0.98
tpcds_q49/duckdb:vortex-file-compressed 33748326 34799929 0.97
tpcds_q50/duckdb:vortex-file-compressed 29227738 26983024 1.08
tpcds_q51/duckdb:vortex-file-compressed 107227224 107733145 1.00
tpcds_q52/duckdb:vortex-file-compressed 13490439 13440024 1.00
tpcds_q53/duckdb:vortex-file-compressed 23888577 24868278 0.96
tpcds_q54/duckdb:vortex-file-compressed 30724712 31798060 0.97
tpcds_q55/duckdb:vortex-file-compressed 13037401 13275601 0.98
tpcds_q56/duckdb:vortex-file-compressed 26031889 25871155 1.01
tpcds_q57/duckdb:vortex-file-compressed 43256762 43706048 0.99
tpcds_q58/duckdb:vortex-file-compressed 31275980 31959000 0.98
tpcds_q59/duckdb:vortex-file-compressed 57364356 57518570 1.00
tpcds_q60/duckdb:vortex-file-compressed 27193383 26480161 1.03
tpcds_q61/duckdb:vortex-file-compressed 31726468 31255628 1.02
tpcds_q62/duckdb:vortex-file-compressed 16223373 17199504 0.94
tpcds_q63/duckdb:vortex-file-compressed 21488247 22427887 0.96
tpcds_q64/duckdb:vortex-file-compressed 98121901 104678297 0.94
tpcds_q65/duckdb:vortex-file-compressed 23927955 24117981 0.99
tpcds_q66/duckdb:vortex-file-compressed 31620823 31623341 1.00
tpcds_q67/duckdb:vortex-file-compressed 147722481 147748868 1.00
tpcds_q68/duckdb:vortex-file-compressed 31160982 32595681 0.96
tpcds_q69/duckdb:vortex-file-compressed 42669786 42189158 1.01
tpcds_q70/duckdb:vortex-file-compressed 39264685 39259056 1.00
tpcds_q71/duckdb:vortex-file-compressed 22036657 21927774 1.00
tpcds_q72/duckdb:vortex-file-compressed 174002485 175048488 0.99
tpcds_q73/duckdb:vortex-file-compressed 25814575 25504091 1.01
tpcds_q74/duckdb:vortex-file-compressed 44132023 44337523 1.00
tpcds_q75/duckdb:vortex-file-compressed 52036446 52217396 1.00
tpcds_q76/duckdb:vortex-file-compressed 22182153 22276914 1.00
tpcds_q77/duckdb:vortex-file-compressed 27443851 25361020 1.08
tpcds_q78/duckdb:vortex-file-compressed 83575483 84664474 0.99
tpcds_q79/duckdb:vortex-file-compressed 25993632 25283218 1.03
tpcds_q80/duckdb:vortex-file-compressed 50267252 50066757 1.00
tpcds_q81/duckdb:vortex-file-compressed 32187540 32186072 1.00
tpcds_q82/duckdb:vortex-file-compressed 48360860 47386375 1.02
tpcds_q83/duckdb:vortex-file-compressed 27535970 27005584 1.02
tpcds_q84/duckdb:vortex-file-compressed 17568215 17582566 1.00
tpcds_q85/duckdb:vortex-file-compressed 43519602 44722060 0.97
tpcds_q86/duckdb:vortex-file-compressed 16956633 17582291 0.96
tpcds_q87/duckdb:vortex-file-compressed 43271501 43297017 1.00
tpcds_q88/duckdb:vortex-file-compressed 57613389 53111957 1.08
tpcds_q89/duckdb:vortex-file-compressed 23511383 25232682 0.93
tpcds_q90/duckdb:vortex-file-compressed 11244304 11170578 1.01
tpcds_q91/duckdb:vortex-file-compressed 23711912 24230899 0.98
tpcds_q92/duckdb:vortex-file-compressed 19713082 19779941 1.00
tpcds_q93/duckdb:vortex-file-compressed 30943822 30266849 1.02
tpcds_q94/duckdb:vortex-file-compressed 23515417 24163900 0.97
tpcds_q95/duckdb:vortex-file-compressed 165852087 167876900 0.99
tpcds_q96/duckdb:vortex-file-compressed 13300231 13253754 1.00
tpcds_q97/duckdb:vortex-file-compressed 40599800 40757416 1.00
tpcds_q98/duckdb:vortex-file-compressed 20492334 20474449 1.00
tpcds_q99/duckdb:vortex-file-compressed 23408949 23904750 0.98
duckdb / vortex-compact (1.001x ➖, 2↑ 5↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 30566599 27259405 1.12
tpcds_q02/duckdb:vortex-compact 🚀 32985173 38577737 0.86
tpcds_q03/duckdb:vortex-compact 50679705 49604918 1.02
tpcds_q04/duckdb:vortex-compact 108389570 112693413 0.96
tpcds_q05/duckdb:vortex-compact 45332625 42607711 1.06
tpcds_q06/duckdb:vortex-compact 41845756 41792589 1.00
tpcds_q07/duckdb:vortex-compact 35159118 37391452 0.94
tpcds_q08/duckdb:vortex-compact 42532714 42678864 1.00
tpcds_q09/duckdb:vortex-compact 20017435 20459449 0.98
tpcds_q10/duckdb:vortex-compact 56713966 55723082 1.02
tpcds_q11/duckdb:vortex-compact 77751776 77429657 1.00
tpcds_q12/duckdb:vortex-compact 23248418 22877726 1.02
tpcds_q13/duckdb:vortex-compact 57645624 57405795 1.00
tpcds_q14/duckdb:vortex-compact 122556402 122532176 1.00
tpcds_q15/duckdb:vortex-compact 33091598 31141121 1.06
tpcds_q16/duckdb:vortex-compact 28966487 28721040 1.01
tpcds_q17/duckdb:vortex-compact 57019873 56450268 1.01
tpcds_q18/duckdb:vortex-compact 52180391 53564000 0.97
tpcds_q19/duckdb:vortex-compact 44287609 45362480 0.98
tpcds_q20/duckdb:vortex-compact 22785301 22117312 1.03
tpcds_q21/duckdb:vortex-compact 🚨 21853846 18913660 1.16
tpcds_q22/duckdb:vortex-compact 83745028 82692764 1.01
tpcds_q23/duckdb:vortex-compact 115348391 113368110 1.02
tpcds_q24/duckdb:vortex-compact 60559049 61829539 0.98
tpcds_q25/duckdb:vortex-compact 57738722 55563947 1.04
tpcds_q26/duckdb:vortex-compact 32390206 34499665 0.94
tpcds_q27/duckdb:vortex-compact 38000272 38498650 0.99
tpcds_q28/duckdb:vortex-compact 34232290 35034229 0.98
tpcds_q29/duckdb:vortex-compact 56500249 56162746 1.01
tpcds_q30/duckdb:vortex-compact 30951401 30828838 1.00
tpcds_q31/duckdb:vortex-compact 37975684 37974895 1.00
tpcds_q32/duckdb:vortex-compact 23733677 22860634 1.04
tpcds_q33/duckdb:vortex-compact 33394910 35246827 0.95
tpcds_q34/duckdb:vortex-compact 31852476 32564307 0.98
tpcds_q35/duckdb:vortex-compact 77795602 78687050 0.99
tpcds_q36/duckdb:vortex-compact 37345566 37654704 0.99
tpcds_q37/duckdb:vortex-compact 25743788 24440739 1.05
tpcds_q38/duckdb:vortex-compact 44096583 41192373 1.07
tpcds_q39/duckdb:vortex-compact 🚨 45611709 39459450 1.16
tpcds_q40/duckdb:vortex-compact 25913078 26358766 0.98
tpcds_q41/duckdb:vortex-compact 12543181 12896451 0.97
tpcds_q42/duckdb:vortex-compact 19340920 20749152 0.93
tpcds_q43/duckdb:vortex-compact 🚨 31058075 26203473 1.19
tpcds_q44/duckdb:vortex-compact 31382122 31188925 1.01
tpcds_q45/duckdb:vortex-compact 39229819 37243900 1.05
tpcds_q46/duckdb:vortex-compact 46056445 45734196 1.01
tpcds_q47/duckdb:vortex-compact 66095872 64084062 1.03
tpcds_q48/duckdb:vortex-compact 46291414 47732104 0.97
tpcds_q49/duckdb:vortex-compact 🚀 46881371 52798274 0.89
tpcds_q50/duckdb:vortex-compact 40531105 40947414 0.99
tpcds_q51/duckdb:vortex-compact 113994769 114624827 0.99
tpcds_q52/duckdb:vortex-compact 20858982 21195028 0.98
tpcds_q53/duckdb:vortex-compact 34287805 34045106 1.01
tpcds_q54/duckdb:vortex-compact 39079302 39007188 1.00
tpcds_q55/duckdb:vortex-compact 19185798 19508047 0.98
tpcds_q56/duckdb:vortex-compact 34689651 34765715 1.00
tpcds_q57/duckdb:vortex-compact 47256365 47106863 1.00
tpcds_q58/duckdb:vortex-compact 39018752 37477668 1.04
tpcds_q59/duckdb:vortex-compact 69834506 67873778 1.03
tpcds_q60/duckdb:vortex-compact 37146557 36317732 1.02
tpcds_q61/duckdb:vortex-compact 54532174 54358129 1.00
tpcds_q62/duckdb:vortex-compact 23399154 23319668 1.00
tpcds_q63/duckdb:vortex-compact 33153383 33197278 1.00
tpcds_q64/duckdb:vortex-compact 130215568 133154263 0.98
tpcds_q65/duckdb:vortex-compact 32156323 31524573 1.02
tpcds_q66/duckdb:vortex-compact 36523037 36679626 1.00
tpcds_q67/duckdb:vortex-compact 157320558 156187444 1.01
tpcds_q68/duckdb:vortex-compact 47152813 47283204 1.00
tpcds_q69/duckdb:vortex-compact 58103440 59191740 0.98
tpcds_q70/duckdb:vortex-compact 59385427 59931225 0.99
tpcds_q71/duckdb:vortex-compact 29873272 29466849 1.01
tpcds_q72/duckdb:vortex-compact 185723772 189597531 0.98
tpcds_q73/duckdb:vortex-compact 31670273 30467963 1.04
tpcds_q74/duckdb:vortex-compact 49536384 52089096 0.95
tpcds_q75/duckdb:vortex-compact 63200745 68026295 0.93
tpcds_q76/duckdb:vortex-compact 🚨 33723972 30294264 1.11
tpcds_q77/duckdb:vortex-compact 38010089 38847098 0.98
tpcds_q78/duckdb:vortex-compact 87662254 89340403 0.98
tpcds_q79/duckdb:vortex-compact 41550546 43406826 0.96
tpcds_q80/duckdb:vortex-compact 74045652 73146524 1.01
tpcds_q81/duckdb:vortex-compact 36990523 38682806 0.96
tpcds_q82/duckdb:vortex-compact 52687327 51894126 1.02
tpcds_q83/duckdb:vortex-compact 35752160 37014924 0.97
tpcds_q84/duckdb:vortex-compact 24016307 22062159 1.09
tpcds_q85/duckdb:vortex-compact 58828937 56449761 1.04
tpcds_q86/duckdb:vortex-compact 23591828 23644874 1.00
tpcds_q87/duckdb:vortex-compact 47623653 45706797 1.04
tpcds_q88/duckdb:vortex-compact 80521694 77370214 1.04
tpcds_q89/duckdb:vortex-compact 33751655 33285085 1.01
tpcds_q90/duckdb:vortex-compact 11895519 11984067 0.99
tpcds_q91/duckdb:vortex-compact 43939376 45180099 0.97
tpcds_q92/duckdb:vortex-compact 43156248 47023322 0.92
tpcds_q93/duckdb:vortex-compact 33768439 34160296 0.99
tpcds_q94/duckdb:vortex-compact 28896872 31274142 0.92
tpcds_q95/duckdb:vortex-compact 158031934 166896631 0.95
tpcds_q96/duckdb:vortex-compact 17656959 18356567 0.96
tpcds_q97/duckdb:vortex-compact 43334985 43811555 0.99
tpcds_q98/duckdb:vortex-compact 28268517 28705439 0.98
tpcds_q99/duckdb:vortex-compact 27029879 27742979 0.97
duckdb / parquet (0.999x ➖, 0↑ 3↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30734688 30312165 1.01
tpcds_q02/duckdb:parquet 23672517 25180271 0.94
tpcds_q03/duckdb:parquet 12886193 13450371 0.96
tpcds_q04/duckdb:parquet 174701630 171085283 1.02
tpcds_q05/duckdb:parquet 32775135 34084988 0.96
tpcds_q06/duckdb:parquet 34548303 34859907 0.99
tpcds_q07/duckdb:parquet 24813677 25146993 0.99
tpcds_q08/duckdb:parquet 30305146 30386905 1.00
tpcds_q09/duckdb:parquet 45264107 45728797 0.99
tpcds_q10/duckdb:parquet 40032974 39478897 1.01
tpcds_q11/duckdb:parquet 95460417 94904032 1.01
tpcds_q12/duckdb:parquet 17915955 17923833 1.00
tpcds_q13/duckdb:parquet 35944464 36795477 0.98
tpcds_q14/duckdb:parquet 103286200 103972851 0.99
tpcds_q15/duckdb:parquet 31746374 32341483 0.98
tpcds_q16/duckdb:parquet 23343892 23489778 0.99
tpcds_q17/duckdb:parquet 40207071 41420861 0.97
tpcds_q18/duckdb:parquet 50074222 49103656 1.02
tpcds_q19/duckdb:parquet 32641425 32507942 1.00
tpcds_q20/duckdb:parquet 19256467 19393472 0.99
tpcds_q21/duckdb:parquet 🚨 14224767 12692711 1.12
tpcds_q22/duckdb:parquet 75174717 77368393 0.97
tpcds_q23/duckdb:parquet 83862000 85527469 0.98
tpcds_q24/duckdb:parquet 48713028 48962271 0.99
tpcds_q25/duckdb:parquet 36936389 3712295 0.99
tpcds_q26/duckdb:parquet 40837356 41737487 0.98
tpcds_q27/duckdb:parquet 54512445 55298484 0.99
tpcds_q28/duckdb:parquet 43198444 43692288 0.99
tpcds_q29/duckdb:parquet 37858039 39861050 0.95
tpcds_q30/duckdb:parquet 38448300 38512584 1.00
tpcds_q31/duckdb:parquet 28193770 26529958 1.06
tpcds_q32/duckdb:parquet 13108840 13236740 0.99
tpcds_q33/duckdb:parquet 24163507 24911792 0.97
tpcds_q34/duckdb:parquet 23235845 23876641 0.97
tpcds_q35/duckdb:parquet 62903529 62885397 1.00
tpcds_q36/duckdb:parquet 23474367 22922815 1.02
tpcds_q37/duckdb:parquet 15551863 15651886 0.99
tpcds_q38/duckdb:parquet 42004036 38276899 1.10
tpcds_q39/duckdb:parquet 32956750 33398688 0.99
tpcds_q40/duckdb:parquet 20714484 20551761 1.01
tpcds_q41/duckdb:parquet 9329930 9372618 1.00
tpcds_q42/duckdb:parquet 12654560 13877897 0.91
tpcds_q43/duckdb:parquet 18677773 19575539 0.95
tpcds_q44/duckdb:parquet 27274225 26377486 1.03
tpcds_q45/duckdb:parquet 29528135 30132320 0.98
tpcds_q46/duckdb:parquet 49817284 49371058 1.01
tpcds_q47/duckdb:parquet 51711364 51113630 1.01
tpcds_q48/duckdb:parquet 33194586 33295199 1.00
tpcds_q49/duckdb:parquet 29590120 28595754 1.03
tpcds_q50/duckdb:parquet 26657775 26583137 1.00
tpcds_q51/duckdb:parquet 107999490 108680004 0.99
tpcds_q52/duckdb:parquet 12854429 12325370 1.04
tpcds_q53/duckdb:parquet 19861392 19187985 1.04
tpcds_q54/duckdb:parquet 29672743 29361917 1.01
tpcds_q55/duckdb:parquet 12649316 13394317 0.94
tpcds_q56/duckdb:parquet 23597695 25463892 0.93
tpcds_q57/duckdb:parquet 39401582 39394172 1.00
tpcds_q58/duckdb:parquet 26160067 27399010 0.95
tpcds_q59/duckdb:parquet 37305122 36373360 1.03
tpcds_q60/duckdb:parquet 25568825 25458646 1.00
tpcds_q61/duckdb:parquet 33000079 34417955 0.96
tpcds_q62/duckdb:parquet 13171747 12994940 1.01
tpcds_q63/duckdb:parquet 18438896 17716514 1.04
tpcds_q64/duckdb:parquet 77729630 77038381 1.01
tpcds_q65/duckdb:parquet 24447216 22426059 1.09
tpcds_q66/duckdb:parquet 🚨 33277623 30250339 1.10
tpcds_q67/duckdb:parquet 144226616 144748189 1.00
tpcds_q68/duckdb:parquet 40129242 39642209 1.01
tpcds_q69/duckdb:parquet 38700219 40781619 0.95
tpcds_q70/duckdb:parquet 23116569 22508203 1.03
tpcds_q71/duckdb:parquet 23230226 24458958 0.95
tpcds_q72/duckdb:parquet 169051809 169190620 1.00
tpcds_q73/duckdb:parquet 19715232 20396704 0.97
tpcds_q74/duckdb:parquet 131380299 131778534 1.00
tpcds_q75/duckdb:parquet 60976870 58381312 1.04
tpcds_q76/duckdb:parquet 23027929 22651029 1.02
tpcds_q77/duckdb:parquet 25935969 25557738 1.01
tpcds_q78/duckdb:parquet 78861713 80376457 0.98
tpcds_q79/duckdb:parquet 30525294 31371694 0.97
tpcds_q80/duckdb:parquet 45539913 45879183 0.99
tpcds_q81/duckdb:parquet 36498505 35588518 1.03
tpcds_q82/duckdb:parquet 17454100 17625847 0.99
tpcds_q83/duckdb:parquet 19286378 19196646 1.00
tpcds_q84/duckdb:parquet 21274269 22351086 0.95
tpcds_q85/duckdb:parquet 43681172 43448335 1.01
tpcds_q86/duckdb:parquet 14163187 14063926 1.01
tpcds_q87/duckdb:parquet 41251119 40614215 1.02
tpcds_q88/duckdb:parquet 54255242 54473343 1.00
tpcds_q89/duckdb:parquet 21870457 21232328 1.03
tpcds_q90/duckdb:parquet 8722811 8862037 0.98
tpcds_q91/duckdb:parquet 27067938 25340145 1.07
tpcds_q92/duckdb:parquet 13667533 13900683 0.98
tpcds_q93/duckdb:parquet 33177754 34172938 0.97
tpcds_q94/duckdb:parquet 18870624 18915964 1.00
tpcds_q95/duckdb:parquet 🚨 151990672 129395619 1.17
tpcds_q96/duckdb:parquet 10541545 10946036 0.96
tpcds_q97/duckdb:parquet 38946083 40819796 0.95
tpcds_q98/duckdb:parquet 24318798 24323940 1.00
tpcds_q99/duckdb:parquet 20707779 20584842 1.01
duckdb / duckdb (1.026x ➖, 0↑ 5↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 23070692 23140761 1.00
tpcds_q02/duckdb:duckdb 20613183 20110861 1.02
tpcds_q03/duckdb:duckdb 11417777 10943255 1.04
tpcds_q04/duckdb:duckdb 187322403 183112456 1.02
tpcds_q05/duckdb:duckdb 23280086 23963823 0.97
tpcds_q06/duckdb:duckdb 30174026 29117682 1.04
tpcds_q07/duckdb:duckdb 42543505 42249424 1.01
tpcds_q08/duckdb:duckdb 121966426 121536659 1.00
tpcds_q09/duckdb:duckdb 21372554 21107583 1.01
tpcds_q10/duckdb:duckdb 29214574 28771046 1.02
tpcds_q11/duckdb:duckdb 100033018 97966320 1.02
tpcds_q12/duckdb:duckdb 14472435 14749794 0.98
tpcds_q13/duckdb:duckdb 28010317 27437218 1.02
tpcds_q14/duckdb:duckdb 97173644 94962961 1.02
tpcds_q15/duckdb:duckdb 26726669 26590676 1.01
tpcds_q16/duckdb:duckdb 20861194 20263380 1.03
tpcds_q17/duckdb:duckdb 25348337 25676575 0.99
tpcds_q18/duckdb:duckdb 49501078 49556280 1.00
tpcds_q19/duckdb:duckdb 20548117 19755587 1.04
tpcds_q20/duckdb:duckdb 15224359 15248937 1.00
tpcds_q21/duckdb:duckdb 8125529 8270415 0.98
tpcds_q22/duckdb:duckdb 67763442 66560988 1.02
tpcds_q23/duckdb:duckdb 78652706 77962083 1.01
tpcds_q24/duckdb:duckdb 27422799 26683753 1.03
tpcds_q25/duckdb:duckdb 19703814 19832379 0.99
tpcds_q26/duckdb:duckdb 30162867 29597739 1.02
tpcds_q27/duckdb:duckdb 43719788 43254414 1.01
tpcds_q28/duckdb:duckdb 26856906 25526399 1.05
tpcds_q29/duckdb:duckdb 25647133 23895075 1.07
tpcds_q30/duckdb:duckdb 33510810 32305802 1.04
tpcds_q31/duckdb:duckdb 55050689 53751680 1.02
tpcds_q32/duckdb:duckdb 8792688 8806052 1.00
tpcds_q33/duckdb:duckdb 17112500 15854696 1.08
tpcds_q34/duckdb:duckdb 19582864 18138036 1.08
tpcds_q35/duckdb:duckdb 39008211 38200152 1.02
tpcds_q36/duckdb:duckdb 76528028 74506675 1.03
tpcds_q37/duckdb:duckdb 9160536 9319237 0.98
tpcds_q38/duckdb:duckdb 34205524 34424987 0.99
tpcds_q39/duckdb:duckdb 30193557 28829900 1.05
tpcds_q40/duckdb:duckdb 15949832 15690112 1.02
tpcds_q41/duckdb:duckdb 10083572 9910228 1.02
tpcds_q42/duckdb:duckdb 9377508 9480801 0.99
tpcds_q43/duckdb:duckdb 15170580 14737382 1.03
tpcds_q44/duckdb:duckdb 16217843 16423374 0.99
tpcds_q45/duckdb:duckdb 20866526 19601859 1.06
tpcds_q46/duckdb:duckdb 🚨 44434156 40391984 1.10
tpcds_q47/duckdb:duckdb 49473851 47674981 1.04
tpcds_q48/duckdb:duckdb 26756470 25816998 1.04
tpcds_q49/duckdb:duckdb 21657987 21801768 0.99
tpcds_q50/duckdb:duckdb 16792794 16743808 1.00
tpcds_q51/duckdb:duckdb 101380035 102210489 0.99
tpcds_q52/duckdb:duckdb 10041440 9757475 1.03
tpcds_q53/duckdb:duckdb 18809846 17785518 1.06
tpcds_q54/duckdb:duckdb 20692770 19902435 1.04
tpcds_q55/duckdb:duckdb 🚨 10471888 9329558 1.12
tpcds_q56/duckdb:duckdb 18531134 16973401 1.09
tpcds_q57/duckdb:duckdb 38115151 37922267 1.01
tpcds_q58/duckdb:duckdb 17351005 17487254 0.99
tpcds_q59/duckdb:duckdb 37722747 37885254 1.00
tpcds_q60/duckdb:duckdb 18949828 18546731 1.02
tpcds_q61/duckdb:duckdb 17572460 17048788 1.03
tpcds_q62/duckdb:duckdb 10649540 10368756 1.03
tpcds_q63/duckdb:duckdb 17294940 16680890 1.04
tpcds_q64/duckdb:duckdb 63054488 60415095 1.04
tpcds_q65/duckdb:duckdb 37517505 38417490 0.98
tpcds_q66/duckdb:duckdb 27835869 27710638 1.00
tpcds_q67/duckdb:duckdb 141286108 143641590 0.98
tpcds_q68/duckdb:duckdb 🚨 30812670 27372935 1.13
tpcds_q69/duckdb:duckdb 30486830 29327271 1.04
tpcds_q70/duckdb:duckdb 18603889 18527673 1.00
tpcds_q71/duckdb:duckdb 17474089 16656573 1.05
tpcds_q72/duckdb:duckdb 48071571 46925702 1.02
tpcds_q73/duckdb:duckdb 15056448 13923376 1.08
tpcds_q74/duckdb:duckdb 151299674 147887145 1.02
tpcds_q75/duckdb:duckdb 48726149 48249257 1.01
tpcds_q76/duckdb:duckdb 15403281 15281314 1.01
tpcds_q77/duckdb:duckdb 16287615 15737592 1.03
tpcds_q78/duckdb:duckdb 69408138 68865023 1.01
tpcds_q79/duckdb:duckdb 🚨 23639811 20759211 1.14
tpcds_q80/duckdb:duckdb 32734216 33081337 0.99
tpcds_q81/duckdb:duckdb 43992645 41134275 1.07
tpcds_q82/duckdb:duckdb 11014800 10673880 1.03
tpcds_q83/duckdb:duckdb 11745753 11839790 0.99
tpcds_q84/duckdb:duckdb 16903988 15594198 1.08
tpcds_q85/duckdb:duckdb 27633052 27334077 1.01
tpcds_q86/duckdb:duckdb 12616727 12737794 0.99
tpcds_q87/duckdb:duckdb 37616911 37470309 1.00
tpcds_q88/duckdb:duckdb 31594724 29664568 1.07
tpcds_q89/duckdb:duckdb 23163306 22098246 1.05
tpcds_q90/duckdb:duckdb 7023611 6793348 1.03
tpcds_q91/duckdb:duckdb 15799559 15245828 1.04
tpcds_q92/duckdb:duckdb 10693722 10740228 1.00
tpcds_q93/duckdb:duckdb 24879808 24957081 1.00
tpcds_q94/duckdb:duckdb 15990252 15551674 1.03
tpcds_q95/duckdb:duckdb 🚨 140516128 117052523 1.20
tpcds_q96/duckdb:duckdb 6291628 6025278 1.04
tpcds_q97/duckdb:duckdb 33595584 33584810 1.00
tpcds_q98/duckdb:duckdb 21910633 21418744 1.02
tpcds_q99/duckdb:duckdb 17252152 17771912 0.97

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.7% -4.4% -3.4% +20.5% ➖ noise
1 datafusion:vortex-file-compressed -5.1% -4.4% -0.7% +23.6% ➖ noise
1 duckdb:duckdb -0.3% -4.4% +4.3% +22.9% ➖ noise
1 duckdb:vortex-compact +12.1% -4.4% +17.3% +25.8% ➖ noise
1 duckdb:vortex-file-compressed +1.5% -4.4% +6.2% +28.9% ➖ noise
2 datafusion:vortex-compact -4.3% -2.2% -2.1% +14.0% ➖ noise
2 datafusion:vortex-file-compressed +2.2% -2.2% +4.5% +10.0% ➖ noise
2 duckdb:duckdb +2.5% -2.2% +4.8% +10.0% ➖ noise
2 duckdb:vortex-compact -14.5% -2.2% -12.6% +26.8% ➖ noise
2 duckdb:vortex-file-compressed +4.0% -2.2% +6.4% +27.2% ➖ noise
3 datafusion:vortex-compact -1.3% -0.0% -1.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.7% -0.0% +0.8% +10.0% ➖ noise
3 duckdb:duckdb +4.3% -0.0% +4.4% +10.0% ➖ noise
3 duckdb:vortex-compact +2.2% -0.0% +2.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.6% -0.0% -3.6% +10.0% ➖ noise
4 datafusion:vortex-compact +1.0% -1.5% +2.4% +12.0% ➖ noise
4 datafusion:vortex-file-compressed -3.1% -1.5% -1.6% +10.0% ➖ noise
4 duckdb:duckdb +2.3% -1.5% +3.8% +10.0% ➖ noise
4 duckdb:vortex-compact -3.8% -1.5% -2.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.8% -1.5% +2.3% +12.6% ➖ noise
5 datafusion:vortex-compact +3.7% -5.5% +9.8% +21.2% ➖ noise
5 datafusion:vortex-file-compressed +2.2% -5.5% +8.1% +13.2% ➖ noise
5 duckdb:duckdb -2.9% -5.5% +2.8% +14.9% ➖ noise
5 duckdb:vortex-compact +6.4% -5.5% +12.6% +12.4% 🚨 regression
5 duckdb:vortex-file-compressed -3.4% -5.5% +2.3% +12.6% ➖ noise
6 datafusion:vortex-compact +4.7% -3.6% +8.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.4% -3.6% +2.3% +10.0% ➖ noise
6 duckdb:duckdb +3.6% -3.6% +7.5% +13.7% ➖ noise
6 duckdb:vortex-compact +0.1% -3.6% +3.8% +25.7% ➖ noise
6 duckdb:vortex-file-compressed -1.9% -3.6% +1.8% +10.0% ➖ noise
7 datafusion:vortex-compact +1.6% +0.7% +1.0% +16.5% ➖ noise
7 datafusion:vortex-file-compressed -0.4% +0.7% -1.1% +18.3% ➖ noise
7 duckdb:duckdb +0.7% +0.7% +0.0% +10.0% ➖ noise
7 duckdb:vortex-compact -6.0% +0.7% -6.6% +12.0% ➖ noise
7 duckdb:vortex-file-compressed +0.1% +0.7% -0.6% +10.6% ➖ noise
8 datafusion:vortex-compact +3.8% +4.1% -0.3% +26.8% ➖ noise
8 datafusion:vortex-file-compressed +3.6% +4.1% -0.5% +20.6% ➖ noise
8 duckdb:duckdb +0.4% +4.1% -3.6% +10.0% ➖ noise
8 duckdb:vortex-compact -0.3% +4.1% -4.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.0% +4.1% -2.0% +26.9% ➖ noise
9 datafusion:vortex-compact -1.5% +7.1% -8.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.7% +7.1% -6.0% +10.0% ➖ noise
9 duckdb:duckdb +1.3% +7.1% -5.4% +10.0% ➖ noise
9 duckdb:vortex-compact -2.2% +7.1% -8.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +6.5% +7.1% -0.6% +11.1% ➖ noise
10 datafusion:vortex-compact -1.7% +3.7% -5.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.7% +3.7% -6.2% +10.0% ➖ noise
10 duckdb:duckdb +1.5% +3.7% -2.1% +10.0% ➖ noise
10 duckdb:vortex-compact +1.8% +3.7% -1.8% +13.2% ➖ noise
10 duckdb:vortex-file-compressed +2.6% +3.7% -1.1% +10.0% ➖ noise
11 datafusion:vortex-compact -2.9% +0.8% -3.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.6% +0.8% -4.3% +10.0% ➖ noise
11 duckdb:duckdb +2.1% +0.8% +1.3% +10.0% ➖ noise
11 duckdb:vortex-compact +0.4% +0.8% -0.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.5% +0.8% -1.2% +10.0% ➖ noise
12 datafusion:vortex-compact +0.2% +3.6% -3.3% +15.4% ➖ noise
12 datafusion:vortex-file-compressed -3.4% +3.6% -6.8% +11.0% ➖ noise
12 duckdb:duckdb -1.9% +3.6% -5.3% +10.0% ➖ noise
12 duckdb:vortex-compact +1.6% +3.6% -1.9% +24.6% ➖ noise
12 duckdb:vortex-file-compressed +4.0% +3.6% +0.4% +30.0% ➖ noise
13 datafusion:vortex-compact +10.7% -3.3% +14.6% +22.1% ➖ noise
13 datafusion:vortex-file-compressed -3.0% -3.3% +0.3% +10.0% ➖ noise
13 duckdb:duckdb +2.1% -3.3% +5.6% +10.1% ➖ noise
13 duckdb:vortex-compact +0.4% -3.3% +3.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.9% -3.3% +4.4% +12.0% ➖ noise
14 datafusion:vortex-compact +0.8% +0.4% +0.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.2% +0.4% -0.6% +10.0% ➖ noise
14 duckdb:duckdb +2.3% +0.4% +1.9% +10.0% ➖ noise
14 duckdb:vortex-compact +0.0% +0.4% -0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.5% +0.4% -0.9% +10.0% ➖ noise
15 datafusion:vortex-compact +0.3% -2.1% +2.5% +17.7% ➖ noise
15 datafusion:vortex-file-compressed +1.0% -2.1% +3.2% +10.0% ➖ noise
15 duckdb:duckdb +0.5% -2.1% +2.7% +10.0% ➖ noise
15 duckdb:vortex-compact +6.3% -2.1% +8.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.2% -2.1% +2.3% +20.2% ➖ noise
16 datafusion:vortex-compact -5.4% -0.7% -4.8% +25.6% ➖ noise
16 datafusion:vortex-file-compressed -4.7% -0.7% -4.1% +25.8% ➖ noise
16 duckdb:duckdb +3.0% -0.7% +3.7% +14.4% ➖ noise
16 duckdb:vortex-compact +0.9% -0.7% +1.6% +14.4% ➖ noise
16 duckdb:vortex-file-compressed -0.6% -0.7% +0.1% +17.4% ➖ noise
17 datafusion:vortex-compact +6.1% -4.6% +11.2% +11.3% ➖ noise
17 datafusion:vortex-file-compressed +3.5% -4.6% +8.6% +15.1% ➖ noise
17 duckdb:duckdb -1.3% -4.6% +3.5% +10.0% ➖ noise
17 duckdb:vortex-compact +1.0% -4.6% +5.9% +14.7% ➖ noise
17 duckdb:vortex-file-compressed -1.9% -4.6% +2.9% +10.0% ➖ noise
18 datafusion:vortex-compact -0.5% -0.7% +0.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.9% -0.7% -2.2% +10.0% ➖ noise
18 duckdb:duckdb -0.1% -0.7% +0.6% +10.0% ➖ noise
18 duckdb:vortex-compact -2.6% -0.7% -1.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.1% -0.7% -2.4% +15.9% ➖ noise
19 datafusion:vortex-compact -0.9% +0.9% -1.7% +17.7% ➖ noise
19 datafusion:vortex-file-compressed -5.1% +0.9% -5.9% +10.0% ➖ noise
19 duckdb:duckdb +4.0% +0.9% +3.1% +10.0% ➖ noise
19 duckdb:vortex-compact -2.4% +0.9% -3.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.9% +0.9% -3.7% +10.0% ➖ noise
20 datafusion:vortex-compact +1.0% -1.6% +2.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -5.2% -1.6% -3.7% +10.0% ➖ noise
20 duckdb:duckdb -0.2% -1.6% +1.4% +10.0% ➖ noise
20 duckdb:vortex-compact +3.0% -1.6% +4.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -2.4% -1.6% -0.8% +10.0% ➖ noise
21 datafusion:vortex-compact +0.5% +6.8% -5.8% +21.5% ➖ noise
21 datafusion:vortex-file-compressed -0.4% +6.8% -6.7% +20.5% ➖ noise
21 duckdb:duckdb -1.8% +6.8% -8.0% +21.5% ➖ noise
21 duckdb:vortex-compact +15.5% +6.8% +8.2% +17.3% ➖ noise
21 duckdb:vortex-file-compressed +2.0% +6.8% -4.5% +11.4% ➖ noise
22 datafusion:vortex-compact -11.3% -6.8% -4.8% +24.5% ➖ noise
22 datafusion:vortex-file-compressed -5.1% -6.8% +1.8% +28.9% ➖ noise
22 duckdb:duckdb +1.8% -6.8% +9.2% +10.0% ➖ noise
22 duckdb:vortex-compact +1.3% -6.8% +8.7% +12.3% ➖ noise
22 duckdb:vortex-file-compressed -6.3% -6.8% +0.5% +13.8% ➖ noise
23 datafusion:vortex-compact -4.2% -0.3% -3.9% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +3.1% -0.3% +3.4% +10.0% ➖ noise
23 duckdb:duckdb +0.9% -0.3% +1.2% +15.0% ➖ noise
23 duckdb:vortex-compact +1.7% -0.3% +2.0% +13.4% ➖ noise
23 duckdb:vortex-file-compressed +9.4% -0.3% +9.7% +14.1% ➖ noise
24 datafusion:vortex-compact +1.5% -0.1% +1.5% +20.6% ➖ noise
24 datafusion:vortex-file-compressed +1.8% -0.1% +1.8% +10.8% ➖ noise
24 duckdb:duckdb +2.8% -0.1% +2.8% +10.0% ➖ noise
24 duckdb:vortex-compact -2.1% -0.1% -2.0% +11.9% ➖ noise
24 duckdb:vortex-file-compressed -0.4% -0.1% -0.3% +14.6% ➖ noise
25 datafusion:vortex-compact -1.7% -0.1% -1.6% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -1.2% -0.1% -1.1% +10.0% ➖ noise
25 duckdb:duckdb -0.6% -0.1% -0.6% +10.0% ➖ noise
25 duckdb:vortex-compact +3.9% -0.1% +4.0% +17.4% ➖ noise
25 duckdb:vortex-file-compressed +3.9% -0.1% +4.0% +12.0% ➖ noise
26 datafusion:vortex-compact -2.2% -0.9% -1.3% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +3.1% -0.9% +4.1% +10.0% ➖ noise
26 duckdb:duckdb +1.9% -0.9% +2.8% +10.0% ➖ noise
26 duckdb:vortex-compact -6.1% -0.9% -5.3% +16.7% ➖ noise
26 duckdb:vortex-file-compressed +1.5% -0.9% +2.4% +10.3% ➖ noise
27 datafusion:vortex-compact -3.8% +0.1% -3.9% +11.9% ➖ noise
27 datafusion:vortex-file-compressed +0.1% +0.1% -0.0% +14.6% ➖ noise
27 duckdb:duckdb +1.1% +0.1% +0.9% +10.0% ➖ noise
27 duckdb:vortex-compact -1.3% +0.1% -1.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.2% +0.1% +0.1% +10.0% ➖ noise
28 datafusion:vortex-compact -0.9% +0.3% -1.2% +10.7% ➖ noise
28 datafusion:vortex-file-compressed -2.2% +0.3% -2.5% +10.0% ➖ noise
28 duckdb:duckdb +5.2% +0.3% +4.9% +10.0% ➖ noise
28 duckdb:vortex-compact -2.3% +0.3% -2.6% +21.7% ➖ noise
28 duckdb:vortex-file-compressed +2.5% +0.3% +2.2% +10.0% ➖ noise
29 datafusion:vortex-compact +0.0% -1.4% +1.4% +16.8% ➖ noise
29 datafusion:vortex-file-compressed -3.7% -1.4% -2.3% +10.8% ➖ noise
29 duckdb:duckdb +7.3% -1.4% +8.8% +10.0% ➖ noise
29 duckdb:vortex-compact +0.6% -1.4% +2.0% +13.8% ➖ noise
29 duckdb:vortex-file-compressed +1.3% -1.4% +2.7% +24.6% ➖ noise
30 datafusion:vortex-compact -11.2% +0.7% -11.8% +11.2% ✅ faster
30 datafusion:vortex-file-compressed -11.8% +0.7% -12.4% +13.2% ✅ faster
30 duckdb:duckdb +3.7% +0.7% +3.0% +15.6% ➖ noise
30 duckdb:vortex-compact +0.4% +0.7% -0.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +4.5% +0.7% +3.8% +10.0% ➖ noise
31 datafusion:vortex-compact -2.6% +2.9% -5.4% +13.5% ➖ noise
31 datafusion:vortex-file-compressed +1.9% +2.9% -1.0% +10.7% ➖ noise
31 duckdb:duckdb +2.4% +2.9% -0.5% +10.0% ➖ noise
31 duckdb:vortex-compact +0.0% +2.9% -2.8% +10.3% ➖ noise
31 duckdb:vortex-file-compressed -4.0% +2.9% -6.7% +13.3% ➖ noise
32 datafusion:vortex-compact -2.6% -0.9% -1.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -2.0% -0.9% -1.1% +10.0% ➖ noise
32 duckdb:duckdb -0.2% -0.9% +0.8% +10.0% ➖ noise
32 duckdb:vortex-compact +3.8% -0.9% +4.8% +37.7% ➖ noise
32 duckdb:vortex-file-compressed -0.3% -0.9% +0.6% +10.0% ➖ noise
33 datafusion:vortex-compact -2.4% -2.4% +0.0% +12.7% ➖ noise
33 datafusion:vortex-file-compressed -1.2% -2.4% +1.2% +10.0% ➖ noise
33 duckdb:duckdb +7.9% -2.4% +10.6% +10.0% 🚨 regression
33 duckdb:vortex-compact -5.3% -2.4% -2.9% +20.7% ➖ noise
33 duckdb:vortex-file-compressed +0.4% -2.4% +2.9% +15.5% ➖ noise
34 datafusion:vortex-compact -0.1% -6.3% +6.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -6.3% -6.3% +0.0% +12.2% ➖ noise
34 duckdb:duckdb +8.0% -6.3% +15.3% +10.0% 🚨 regression
34 duckdb:vortex-compact -2.2% -6.3% +4.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -14.4% -6.3% -8.6% +17.5% ➖ noise
35 datafusion:vortex-compact +1.1% +1.4% -0.3% +16.3% ➖ noise
35 datafusion:vortex-file-compressed -3.5% +1.4% -4.9% +10.9% ➖ noise
35 duckdb:duckdb +2.1% +1.4% +0.7% +10.6% ➖ noise
35 duckdb:vortex-compact -1.1% +1.4% -2.5% +11.9% ➖ noise
35 duckdb:vortex-file-compressed +0.7% +1.4% -0.8% +10.0% ➖ noise
36 datafusion:vortex-compact -0.9% +1.8% -2.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.2% +1.8% +1.3% +10.0% ➖ noise
36 duckdb:duckdb +2.7% +1.8% +0.9% +10.0% ➖ noise
36 duckdb:vortex-compact -0.8% +1.8% -2.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +1.9% +1.8% +0.1% +10.0% ➖ noise
37 datafusion:vortex-compact -0.5% -0.6% +0.1% +12.8% ➖ noise
37 datafusion:vortex-file-compressed -1.0% -0.6% -0.4% +10.0% ➖ noise
37 duckdb:duckdb -1.7% -0.6% -1.1% +10.0% ➖ noise
37 duckdb:vortex-compact +5.3% -0.6% +6.0% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +4.2% -0.6% +4.9% +26.0% ➖ noise
38 datafusion:vortex-compact -4.4% +0.9% -5.2% +14.9% ➖ noise
38 datafusion:vortex-file-compressed -4.0% +0.9% -4.8% +10.0% ➖ noise
38 duckdb:duckdb -0.6% +0.9% -1.5% +10.0% ➖ noise
38 duckdb:vortex-compact +7.1% +0.9% +6.1% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +0.2% +0.9% -0.7% +10.4% ➖ noise
39 datafusion:vortex-compact -1.3% -4.1% +2.9% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -4.7% -4.1% -0.6% +10.0% ➖ noise
39 duckdb:duckdb +4.7% -4.1% +9.2% +23.0% ➖ noise
39 duckdb:vortex-compact +15.6% -4.1% +20.5% +20.5% 🚨 regression
39 duckdb:vortex-file-compressed +0.8% -4.1% +5.1% +10.0% ➖ noise
40 datafusion:vortex-compact -0.3% -2.5% +2.3% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -1.2% -2.5% +1.4% +10.0% ➖ noise
40 duckdb:duckdb +1.7% -2.5% +4.3% +10.0% ➖ noise
40 duckdb:vortex-compact -1.7% -2.5% +0.9% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +4.0% -2.5% +6.7% +10.0% ➖ noise
41 datafusion:vortex-compact -1.5% -0.4% -1.0% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +0.6% -0.4% +1.0% +10.0% ➖ noise
41 duckdb:duckdb +1.7% -0.4% +2.2% +10.0% ➖ noise
41 duckdb:vortex-compact -2.7% -0.4% -2.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +1.6% -0.4% +2.1% +10.0% ➖ noise
42 datafusion:vortex-compact -1.1% -5.5% +4.7% +27.6% ➖ noise
42 datafusion:vortex-file-compressed +0.7% -5.5% +6.5% +10.0% ➖ noise
42 duckdb:duckdb -1.1% -5.5% +4.7% +15.1% ➖ noise
42 duckdb:vortex-compact -6.8% -5.5% -1.4% +10.3% ➖ noise
42 duckdb:vortex-file-compressed +7.2% -5.5% +13.5% +33.4% ➖ noise
43 datafusion:vortex-compact -3.0% -0.4% -2.6% +15.3% ➖ noise
43 datafusion:vortex-file-compressed +2.6% -0.4% +3.0% +16.7% ➖ noise
43 duckdb:duckdb +2.9% -0.4% +3.4% +11.8% ➖ noise
43 duckdb:vortex-compact +18.5% -0.4% +19.0% +30.7% ➖ noise
43 duckdb:vortex-file-compressed -4.7% -0.4% -4.4% +10.6% ➖ noise
44 datafusion:vortex-compact +1.7% -1.0% +2.7% +11.3% ➖ noise
44 datafusion:vortex-file-compressed -3.2% -1.0% -2.3% +12.9% ➖ noise
44 duckdb:duckdb -1.3% -1.0% -0.2% +10.0% ➖ noise
44 duckdb:vortex-compact +0.6% -1.0% +1.6% +14.8% ➖ noise
44 duckdb:vortex-file-compressed -3.8% -1.0% -2.8% +10.0% ➖ noise
45 datafusion:vortex-compact -3.5% -1.0% -2.6% +11.4% ➖ noise
45 datafusion:vortex-file-compressed +2.9% -1.0% +3.9% +15.1% ➖ noise
45 duckdb:duckdb +6.5% -1.0% +7.5% +10.0% ➖ noise
45 duckdb:vortex-compact +5.3% -1.0% +6.4% +10.2% ➖ noise
45 duckdb:vortex-file-compressed -1.2% -1.0% -0.2% +10.0% ➖ noise
46 datafusion:vortex-compact -2.1% -2.4% +0.3% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -0.4% -2.4% +2.1% +11.6% ➖ noise
46 duckdb:duckdb +10.0% -2.4% +12.7% +10.0% 🚨 regression
46 duckdb:vortex-compact +0.7% -2.4% +3.2% +11.3% ➖ noise
46 duckdb:vortex-file-compressed -4.0% -2.4% -1.7% +10.9% ➖ noise
47 datafusion:vortex-compact -0.3% -0.3% +0.0% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -0.9% -0.3% -0.5% +10.0% ➖ noise
47 duckdb:duckdb +3.8% -0.3% +4.1% +10.0% ➖ noise
47 duckdb:vortex-compact +3.1% -0.3% +3.5% +12.8% ➖ noise
47 duckdb:vortex-file-compressed +0.3% -0.3% +0.6% +13.0% ➖ noise
48 datafusion:vortex-compact -14.9% +2.2% -16.8% +24.8% ➖ noise
48 datafusion:vortex-file-compressed +3.8% +2.2% +1.6% +12.0% ➖ noise
48 duckdb:duckdb +3.6% +2.2% +1.4% +10.0% ➖ noise
48 duckdb:vortex-compact -3.0% +2.2% -5.1% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -1.8% +2.2% -3.9% +10.0% ➖ noise
49 datafusion:vortex-compact +1.8% +2.1% -0.3% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +2.0% +2.1% -0.1% +10.0% ➖ noise
49 duckdb:duckdb -0.7% +2.1% -2.7% +10.0% ➖ noise
49 duckdb:vortex-compact -11.2% +2.1% -13.0% +11.3% ✅ faster
49 duckdb:vortex-file-compressed -3.0% +2.1% -5.0% +11.3% ➖ noise
50 datafusion:vortex-compact -1.8% -1.3% -0.5% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -2.8% -1.3% -1.5% +18.3% ➖ noise
50 duckdb:duckdb +0.3% -1.3% +1.6% +10.0% ➖ noise
50 duckdb:vortex-compact -1.0% -1.3% +0.3% +17.3% ➖ noise
50 duckdb:vortex-file-compressed +8.3% -1.3% +9.7% +33.2% ➖ noise
51 datafusion:vortex-compact -2.4% -1.2% -1.1% +16.2% ➖ noise
51 datafusion:vortex-file-compressed +1.2% -1.2% +2.5% +14.1% ➖ noise
51 duckdb:duckdb -0.8% -1.2% +0.4% +18.7% ➖ noise
51 duckdb:vortex-compact -0.5% -1.2% +0.7% +23.0% ➖ noise
51 duckdb:vortex-file-compressed -0.5% -1.2% +0.8% +22.3% ➖ noise
52 datafusion:vortex-compact -0.3% +1.1% -1.5% +15.2% ➖ noise
52 datafusion:vortex-file-compressed +3.6% +1.1% +2.4% +11.8% ➖ noise
52 duckdb:duckdb +2.9% +1.1% +1.7% +14.2% ➖ noise
52 duckdb:vortex-compact -1.6% +1.1% -2.7% +23.8% ➖ noise
52 duckdb:vortex-file-compressed +0.4% +1.1% -0.8% +11.6% ➖ noise
53 datafusion:vortex-compact -5.7% +1.6% -7.2% +20.4% ➖ noise
53 datafusion:vortex-file-compressed -0.9% +1.6% -2.4% +10.0% ➖ noise
53 duckdb:duckdb +5.8% +1.6% +4.1% +10.2% ➖ noise
53 duckdb:vortex-compact +0.7% +1.6% -0.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -3.9% +1.6% -5.4% +39.4% ➖ noise
54 datafusion:vortex-compact -7.6% +1.7% -9.2% +10.0% ✅ faster
54 datafusion:vortex-file-compressed -2.6% +1.7% -4.2% +10.0% ➖ noise
54 duckdb:duckdb +4.0% +1.7% +2.3% +10.0% ➖ noise
54 duckdb:vortex-compact +0.2% +1.7% -1.5% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -3.4% +1.7% -5.0% +10.0% ➖ noise
55 datafusion:vortex-compact -0.1% -0.8% +0.7% +10.6% ➖ noise
55 datafusion:vortex-file-compressed -1.4% -0.8% -0.6% +10.0% ➖ noise
55 duckdb:duckdb +12.2% -0.8% +13.1% +15.2% ➖ noise
55 duckdb:vortex-compact -1.7% -0.8% -0.9% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -1.8% -0.8% -1.0% +10.0% ➖ noise
56 datafusion:vortex-compact -2.8% -3.4% +0.6% +12.8% ➖ noise
56 datafusion:vortex-file-compressed -6.0% -3.4% -2.7% +10.7% ➖ noise
56 duckdb:duckdb +9.2% -3.4% +13.1% +10.0% 🚨 regression
56 duckdb:vortex-compact -0.2% -3.4% +3.3% +24.3% ➖ noise
56 duckdb:vortex-file-compressed +0.6% -3.4% +4.2% +10.0% ➖ noise
57 datafusion:vortex-compact -0.6% -5.2% +4.8% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -1.2% -5.2% +4.2% +10.9% ➖ noise
57 duckdb:duckdb +0.5% -5.2% +6.0% +14.1% ➖ noise
57 duckdb:vortex-compact +0.3% -5.2% +5.8% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -1.0% -5.2% +4.4% +10.0% ➖ noise
58 datafusion:vortex-compact -4.6% -4.8% +0.2% +10.3% ➖ noise
58 datafusion:vortex-file-compressed -7.1% -4.8% -2.4% +10.0% ➖ noise
58 duckdb:duckdb -0.8% -4.8% +4.2% +10.0% ➖ noise
58 duckdb:vortex-compact +4.1% -4.8% +9.4% +10.0% ➖ noise
58 duckdb:vortex-file-compressed -2.1% -4.8% +2.8% +20.5% ➖ noise
59 datafusion:vortex-compact -2.2% +0.3% -2.5% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -0.4% +0.3% -0.7% +10.9% ➖ noise
59 duckdb:duckdb -0.4% +0.3% -0.7% +10.0% ➖ noise
59 duckdb:vortex-compact +2.9% +0.3% +2.6% +11.1% ➖ noise
59 duckdb:vortex-file-compressed -0.3% +0.3% -0.5% +24.7% ➖ noise
60 datafusion:vortex-compact -3.4% +2.2% -5.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -7.8% +2.2% -9.7% +15.1% ➖ noise
60 duckdb:duckdb +2.2% +2.2% +0.0% +10.0% ➖ noise
60 duckdb:vortex-compact +2.3% +2.2% +0.1% +10.4% ➖ noise
60 duckdb:vortex-file-compressed +2.7% +2.2% +0.5% +10.0% ➖ noise
61 datafusion:vortex-compact +2.1% -2.8% +5.1% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -3.9% -2.8% -1.1% +10.0% ➖ noise
61 duckdb:duckdb +3.1% -2.8% +6.1% +10.0% ➖ noise
61 duckdb:vortex-compact +0.3% -2.8% +3.2% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +1.5% -2.8% +4.4% +15.2% ➖ noise
62 datafusion:vortex-compact +11.0% +0.1% +10.8% +30.2% ➖ noise
62 datafusion:vortex-file-compressed +4.7% +0.1% +4.6% +21.8% ➖ noise
62 duckdb:duckdb +2.7% +0.1% +2.6% +15.1% ➖ noise
62 duckdb:vortex-compact +0.3% +0.1% +0.2% +27.1% ➖ noise
62 duckdb:vortex-file-compressed -5.7% +0.1% -5.8% +15.0% ➖ noise
63 datafusion:vortex-compact +0.3% -0.2% +0.5% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +3.7% -0.2% +4.0% +18.1% ➖ noise
63 duckdb:duckdb +3.7% -0.2% +3.9% +10.0% ➖ noise
63 duckdb:vortex-compact -0.1% -0.2% +0.1% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -4.2% -0.2% -4.0% +10.0% ➖ noise
64 datafusion:vortex-compact -2.9% +0.2% -3.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.0% +0.2% -0.3% +10.0% ➖ noise
64 duckdb:duckdb +4.4% +0.2% +4.1% +10.0% ➖ noise
64 duckdb:vortex-compact -2.2% +0.2% -2.4% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -6.3% +0.2% -6.5% +11.5% ➖ noise
65 datafusion:vortex-compact +1.7% +2.4% -0.6% +15.1% ➖ noise
65 datafusion:vortex-file-compressed +8.4% +2.4% +5.9% +10.7% ➖ noise
65 duckdb:duckdb -2.3% +2.4% -4.6% +10.0% ➖ noise
65 duckdb:vortex-compact +2.0% +2.4% -0.4% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -0.8% +2.4% -3.1% +10.0% ➖ noise
66 datafusion:vortex-compact -6.0% +9.6% -14.2% +14.3% ✅ faster
66 datafusion:vortex-file-compressed -1.7% +9.6% -10.3% +11.5% ✅ faster
66 duckdb:duckdb +0.5% +9.6% -8.4% +11.4% ➖ noise
66 duckdb:vortex-compact -0.4% +9.6% -9.2% +16.4% ➖ noise
66 duckdb:vortex-file-compressed -0.0% +9.6% -8.8% +19.7% ➖ noise
67 datafusion:vortex-compact -1.1% +0.6% -1.7% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -0.8% +0.6% -1.4% +10.0% ➖ noise
67 duckdb:duckdb -1.6% +0.6% -2.2% +10.0% ➖ noise
67 duckdb:vortex-compact +0.7% +0.6% +0.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -0.0% +0.6% -0.6% +10.0% ➖ noise
68 datafusion:vortex-compact -8.2% +1.7% -9.7% +22.7% ➖ noise
68 datafusion:vortex-file-compressed -1.7% +1.7% -3.4% +10.9% ➖ noise
68 duckdb:duckdb +12.6% +1.7% +10.6% +10.7% ➖ noise
68 duckdb:vortex-compact -0.3% +1.7% -2.0% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -4.4% +1.7% -6.0% +13.0% ➖ noise
69 datafusion:vortex-compact -1.6% -3.1% +1.6% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -3.4% -3.1% -0.3% +11.6% ➖ noise
69 duckdb:duckdb +4.0% -3.1% +7.3% +10.0% ➖ noise
69 duckdb:vortex-compact -1.8% -3.1% +1.3% +13.5% ➖ noise
69 duckdb:vortex-file-compressed +1.1% -3.1% +4.4% +18.3% ➖ noise
70 datafusion:vortex-compact -0.5% +1.2% -1.7% +14.0% ➖ noise
70 datafusion:vortex-file-compressed -3.2% +1.2% -4.4% +10.0% ➖ noise
70 duckdb:duckdb +0.4% +1.2% -0.8% +10.3% ➖ noise
70 duckdb:vortex-compact -0.9% +1.2% -2.1% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +0.0% +1.2% -1.2% +12.0% ➖ noise
71 datafusion:vortex-compact +1.9% -0.8% +2.7% +12.5% ➖ noise
71 datafusion:vortex-file-compressed -1.0% -0.8% -0.2% +11.9% ➖ noise
71 duckdb:duckdb +4.9% -0.8% +5.8% +10.9% ➖ noise
71 duckdb:vortex-compact +1.4% -0.8% +2.2% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +0.5% -0.8% +1.3% +10.0% ➖ noise
72 datafusion:vortex-compact +1.8% +1.5% +0.3% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +1.7% +1.5% +0.2% +10.0% ➖ noise
72 duckdb:duckdb +2.4% +1.5% +0.9% +10.0% ➖ noise
72 duckdb:vortex-compact -2.0% +1.5% -3.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.6% +1.5% -2.1% +10.0% ➖ noise
73 datafusion:vortex-compact +3.0% +0.1% +2.8% +22.4% ➖ noise
73 datafusion:vortex-file-compressed -0.5% +0.1% -0.6% +10.0% ➖ noise
73 duckdb:duckdb +8.1% +0.1% +8.0% +11.7% ➖ noise
73 duckdb:vortex-compact +3.9% +0.1% +3.8% +29.2% ➖ noise
73 duckdb:vortex-file-compressed +1.2% +0.1% +1.1% +10.0% ➖ noise
74 datafusion:vortex-compact +1.2% -0.1% +1.3% +11.7% ➖ noise
74 datafusion:vortex-file-compressed +2.1% -0.1% +2.2% +15.2% ➖ noise
74 duckdb:duckdb +2.3% -0.1% +2.4% +10.0% ➖ noise
74 duckdb:vortex-compact -4.9% -0.1% -4.8% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -0.5% -0.1% -0.3% +10.0% ➖ noise
75 datafusion:vortex-compact -1.5% +2.6% -3.9% +11.4% ➖ noise
75 datafusion:vortex-file-compressed -0.1% +2.6% -2.6% +10.0% ➖ noise
75 duckdb:duckdb +1.0% +2.6% -1.5% +10.0% ➖ noise
75 duckdb:vortex-compact -7.1% +2.6% -9.4% +10.8% ➖ noise
75 duckdb:vortex-file-compressed -0.3% +2.6% -2.8% +14.5% ➖ noise
76 datafusion:vortex-compact -0.1% -0.6% +0.5% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -6.2% -0.6% -5.7% +15.7% ➖ noise
76 duckdb:duckdb +0.8% -0.6% +1.4% +10.0% ➖ noise
76 duckdb:vortex-compact +11.3% -0.6% +11.9% +14.9% ➖ noise
76 duckdb:vortex-file-compressed -0.4% -0.6% +0.1% +10.0% ➖ noise
77 datafusion:vortex-compact -1.9% +0.7% -2.6% +15.6% ➖ noise
77 datafusion:vortex-file-compressed +9.8% +0.7% +9.0% +21.9% ➖ noise
77 duckdb:duckdb +3.5% +0.7% +2.8% +11.4% ➖ noise
77 duckdb:vortex-compact -2.2% +0.7% -2.8% +13.9% ➖ noise
77 duckdb:vortex-file-compressed +8.2% +0.7% +7.5% +16.2% ➖ noise
78 datafusion:vortex-compact -0.8% -1.5% +0.7% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -2.4% -1.5% -1.0% +10.0% ➖ noise
78 duckdb:duckdb +0.8% -1.5% +2.3% +10.0% ➖ noise
78 duckdb:vortex-compact -1.9% -1.5% -0.4% +15.2% ➖ noise
78 duckdb:vortex-file-compressed -1.3% -1.5% +0.2% +10.7% ➖ noise
79 datafusion:vortex-compact -1.4% -0.9% -0.5% +19.8% ➖ noise
79 datafusion:vortex-file-compressed -3.2% -0.9% -2.3% +19.8% ➖ noise
79 duckdb:duckdb +13.9% -0.9% +14.9% +11.7% 🚨 regression
79 duckdb:vortex-compact -4.3% -0.9% -3.4% +12.0% ➖ noise
79 duckdb:vortex-file-compressed +2.8% -0.9% +3.8% +10.0% ➖ noise
80 datafusion:vortex-compact -4.6% -0.1% -4.5% +20.5% ➖ noise
80 datafusion:vortex-file-compressed -3.7% -0.1% -3.6% +10.0% ➖ noise
80 duckdb:duckdb -1.0% -0.1% -1.0% +10.0% ➖ noise
80 duckdb:vortex-compact +1.2% -0.1% +1.3% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +0.4% -0.1% +0.5% +10.3% ➖ noise
81 datafusion:vortex-compact -0.6% -1.0% +0.5% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +0.9% -1.0% +2.0% +10.0% ➖ noise
81 duckdb:duckdb +6.9% -1.0% +8.1% +10.0% ➖ noise
81 duckdb:vortex-compact -4.4% -1.0% -3.4% +19.7% ➖ noise
81 duckdb:vortex-file-compressed +0.0% -1.0% +1.0% +14.8% ➖ noise
82 datafusion:vortex-compact +1.2% -2.4% +3.7% +15.8% ➖ noise
82 datafusion:vortex-file-compressed -1.1% -2.4% +1.4% +10.0% ➖ noise
82 duckdb:duckdb +3.2% -2.4% +5.8% +14.1% ➖ noise
82 duckdb:vortex-compact +1.5% -2.4% +4.1% +10.0% ➖ noise
82 duckdb:vortex-file-compressed +2.1% -2.4% +4.6% +10.0% ➖ noise
83 datafusion:vortex-compact -6.0% -0.1% -6.0% +13.1% ➖ noise
83 datafusion:vortex-file-compressed -1.9% -0.1% -1.8% +13.6% ➖ noise
83 duckdb:duckdb -0.8% -0.1% -0.7% +10.0% ➖ noise
83 duckdb:vortex-compact -3.4% -0.1% -3.3% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +2.0% -0.1% +2.0% +10.0% ➖ noise
84 datafusion:vortex-compact -4.3% -3.9% -0.3% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -3.8% -3.9% +0.1% +67.8% ➖ noise
84 duckdb:duckdb +8.4% -3.9% +12.9% +10.0% 🚨 regression
84 duckdb:vortex-compact +8.9% -3.9% +13.3% +21.5% ➖ noise
84 duckdb:vortex-file-compressed -0.1% -3.9% +4.0% +10.0% ➖ noise
85 datafusion:vortex-compact -8.5% -1.4% -7.3% +23.9% ➖ noise
85 datafusion:vortex-file-compressed -3.2% -1.4% -1.9% +10.0% ➖ noise
85 duckdb:duckdb +1.1% -1.4% +2.5% +10.0% ➖ noise
85 duckdb:vortex-compact +4.2% -1.4% +5.7% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -2.7% -1.4% -1.3% +10.0% ➖ noise
86 datafusion:vortex-compact -2.4% -0.2% -2.2% +13.5% ➖ noise
86 datafusion:vortex-file-compressed -3.9% -0.2% -3.7% +16.5% ➖ noise
86 duckdb:duckdb -1.0% -0.2% -0.7% +10.0% ➖ noise
86 duckdb:vortex-compact -0.2% -0.2% +0.0% +15.1% ➖ noise
86 duckdb:vortex-file-compressed -3.6% -0.2% -3.3% +12.4% ➖ noise
87 datafusion:vortex-compact -5.4% -0.7% -4.8% +15.0% ➖ noise
87 datafusion:vortex-file-compressed -1.1% -0.7% -0.5% +10.0% ➖ noise
87 duckdb:duckdb +0.4% -0.7% +1.1% +10.2% ➖ noise
87 duckdb:vortex-compact +4.2% -0.7% +4.9% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -0.1% -0.7% +0.6% +10.0% ➖ noise
88 datafusion:vortex-compact -1.6% +0.4% -2.0% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.6% +0.4% +0.2% +12.0% ➖ noise
88 duckdb:duckdb +6.5% +0.4% +6.1% +10.0% ➖ noise
88 duckdb:vortex-compact +4.1% +0.4% +3.7% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +8.5% +0.4% +8.1% +10.0% ➖ noise
89 datafusion:vortex-compact -1.5% +5.6% -6.7% +23.4% ➖ noise
89 datafusion:vortex-file-compressed -7.9% +5.6% -12.7% +13.8% ✅ faster
89 duckdb:duckdb +4.8% +5.6% -0.7% +10.0% ➖ noise
89 duckdb:vortex-compact +1.4% +5.6% -3.9% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -6.8% +5.6% -11.7% +26.4% ➖ noise
90 datafusion:vortex-compact -3.0% -1.3% -1.7% +10.9% ➖ noise
90 datafusion:vortex-file-compressed -4.0% -1.3% -2.7% +10.9% ➖ noise
90 duckdb:duckdb +3.4% -1.3% +4.8% +10.0% ➖ noise
90 duckdb:vortex-compact -0.7% -1.3% +0.6% +14.7% ➖ noise
90 duckdb:vortex-file-compressed +0.7% -1.3% +2.0% +12.4% ➖ noise
91 datafusion:vortex-compact +0.8% +3.2% -2.3% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -6.9% +3.2% -9.7% +10.0% ✅ faster
91 duckdb:duckdb +3.6% +3.2% +0.5% +10.7% ➖ noise
91 duckdb:vortex-compact -2.7% +3.2% -5.7% +18.5% ➖ noise
91 duckdb:vortex-file-compressed -2.1% +3.2% -5.1% +10.0% ➖ noise
92 datafusion:vortex-compact +9.4% -0.8% +10.3% +24.4% ➖ noise
92 datafusion:vortex-file-compressed -5.2% -0.8% -4.5% +13.5% ➖ noise
92 duckdb:duckdb -0.4% -0.8% +0.3% +11.5% ➖ noise
92 duckdb:vortex-compact -8.2% -0.8% -7.5% +15.2% ➖ noise
92 duckdb:vortex-file-compressed -0.3% -0.8% +0.4% +10.4% ➖ noise
93 datafusion:vortex-compact +0.6% -3.6% +4.4% +10.9% ➖ noise
93 datafusion:vortex-file-compressed -4.4% -3.6% -0.7% +15.2% ➖ noise
93 duckdb:duckdb -0.3% -3.6% +3.5% +10.0% ➖ noise
93 duckdb:vortex-compact -1.1% -3.6% +2.6% +10.0% ➖ noise
93 duckdb:vortex-file-compressed +2.2% -3.6% +6.1% +15.3% ➖ noise
94 datafusion:vortex-compact -5.7% -1.8% -4.0% +18.9% ➖ noise
94 datafusion:vortex-file-compressed +4.3% -1.8% +6.2% +20.0% ➖ noise
94 duckdb:duckdb +2.8% -1.8% +4.7% +13.9% ➖ noise
94 duckdb:vortex-compact -7.6% -1.8% -5.9% +26.3% ➖ noise
94 duckdb:vortex-file-compressed -2.7% -1.8% -0.9% +19.0% ➖ noise
95 datafusion:vortex-compact +3.1% +7.1% -3.7% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +0.2% +7.1% -6.4% +13.9% ➖ noise
95 duckdb:duckdb +20.0% +7.1% +12.1% +17.3% ➖ noise
95 duckdb:vortex-compact -5.3% +7.1% -11.6% +15.6% ➖ noise
95 duckdb:vortex-file-compressed -1.2% +7.1% -7.8% +17.8% ➖ noise
96 datafusion:vortex-compact +3.0% +0.8% +2.2% +25.5% ➖ noise
96 datafusion:vortex-file-compressed -3.9% +0.8% -4.6% +23.4% ➖ noise
96 duckdb:duckdb +4.4% +0.8% +3.6% +14.4% ➖ noise
96 duckdb:vortex-compact -3.8% +0.8% -4.6% +34.1% ➖ noise
96 duckdb:vortex-file-compressed +0.4% +0.8% -0.4% +15.3% ➖ noise
97 datafusion:vortex-compact -1.0% -5.5% +4.7% +20.7% ➖ noise
97 datafusion:vortex-file-compressed -6.2% -5.5% -0.7% +10.0% ➖ noise
97 duckdb:duckdb +0.0% -5.5% +5.8% +19.7% ➖ noise
97 duckdb:vortex-compact -1.1% -5.5% +4.6% +10.0% ➖ noise
97 duckdb:vortex-file-compressed -0.4% -5.5% +5.4% +10.0% ➖ noise
98 datafusion:vortex-compact +0.1% +2.4% -2.2% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -1.7% +2.4% -4.0% +10.0% ➖ noise
98 duckdb:duckdb +2.3% +2.4% -0.1% +10.8% ➖ noise
98 duckdb:vortex-compact -1.5% +2.4% -3.8% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +0.1% +2.4% -2.2% +10.0% ➖ noise
99 datafusion:vortex-compact +2.8% +6.7% -3.7% +25.5% ➖ noise
99 datafusion:vortex-file-compressed -12.9% +6.7% -18.4% +25.9% ➖ noise
99 duckdb:duckdb -2.9% +6.7% -9.0% +37.8% ➖ noise
99 duckdb:vortex-compact -2.6% +6.7% -8.7% +18.4% ➖ noise
99 duckdb:vortex-file-compressed -2.1% +6.7% -8.2% +27.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.3%
Engines: DataFusion No clear signal (-16.1%, environment too noisy confidence) · DuckDB No clear signal (+2.3%, low confidence)
Vortex (geomean): 1.011x ➖
Parquet (geomean): 1.091x ➖
Shifts: Parquet (control) +9.1% · Median polish +3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.829x ➖, 3↑ 1↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 57311680 31470545 1.82
fineweb_q01/datafusion:vortex-file-compressed 867257369 997494592 0.87
fineweb_q02/datafusion:vortex-file-compressed 🚀 786525679 1482926539 0.53
fineweb_q03/datafusion:vortex-file-compressed 1397191984 1740853355 0.80
fineweb_q04/datafusion:vortex-file-compressed 1400234933 1577707669 0.89
fineweb_q05/datafusion:vortex-file-compressed 1394729732 1408886270 0.99
fineweb_q06/datafusion:vortex-file-compressed 🚀 1644209917 2578757294 0.64
fineweb_q07/datafusion:vortex-file-compressed 1451044212 1435851072 1.01
fineweb_q08/datafusion:vortex-file-compressed 🚀 507246824 1042618651 0.49
datafusion / vortex-compact (1.078x ➖, 1↑ 2↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 55794621 33014133 1.69
fineweb_q01/datafusion:vortex-compact 🚨 1167888465 528328918 2.21
fineweb_q02/datafusion:vortex-compact 753663565 759485357 0.99
fineweb_q03/datafusion:vortex-compact 1408342140 1374141128 1.02
fineweb_q04/datafusion:vortex-compact 1587488662 1562712943 1.02
fineweb_q05/datafusion:vortex-compact 1375876301 1395794427 0.99
fineweb_q06/datafusion:vortex-compact 🚀 1248779752 1799976327 0.69
fineweb_q07/datafusion:vortex-compact 1217036012 1205796251 1.01
fineweb_q08/datafusion:vortex-compact 378613782 513518284 0.74
datafusion / parquet (1.127x ➖, 0↑ 2↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1166833572 1077706088 1.08
fineweb_q01/datafusion:parquet 2079910971 1869225960 1.11
fineweb_q02/datafusion:parquet 2308039421 1857591388 1.24
fineweb_q03/datafusion:parquet 2025069921 1926067209 1.05
fineweb_q04/datafusion:parquet 1989182253 2249744389 0.88
fineweb_q05/datafusion:parquet 🚨 2326125162 1767873856 1.32
fineweb_q06/datafusion:parquet 1878680209 2032556323 0.92
fineweb_q07/datafusion:parquet 🚨 2552677750 1795723372 1.42
fineweb_q08/datafusion:parquet 2271744076 1858856846 1.22
duckdb / vortex-file-compressed (1.008x ➖, 0↑ 1↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 83754413 99951888 0.84
fineweb_q01/duckdb:vortex-file-compressed 654107846 662529432 0.99
fineweb_q02/duckdb:vortex-file-compressed 🚨 700860527 517921278 1.35
fineweb_q03/duckdb:vortex-file-compressed 1569961319 1426075434 1.10
fineweb_q04/duckdb:vortex-file-compressed 1693459512 1841173482 0.92
fineweb_q05/duckdb:vortex-file-compressed 1588331135 1455115980 1.09
fineweb_q06/duckdb:vortex-file-compressed 1753928472 1752755931 1.00
fineweb_q07/duckdb:vortex-file-compressed 1500289633 1521917355 0.99
fineweb_q08/duckdb:vortex-file-compressed 593230675 671236840 0.88
duckdb / vortex-compact (1.160x ➖, 0↑ 1↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 88093446 80075499 1.10
fineweb_q01/duckdb:vortex-compact 621950154 517573729 1.20
fineweb_q02/duckdb:vortex-compact 700534495 579581426 1.21
fineweb_q03/duckdb:vortex-compact 1667578774 1623409171 1.03
fineweb_q04/duckdb:vortex-compact 1924154011 1626758839 1.18
fineweb_q05/duckdb:vortex-compact 1755400028 1547906386 1.13
fineweb_q06/duckdb:vortex-compact 1657931459 1429456246 1.16
fineweb_q07/duckdb:vortex-compact 1614595571 1473152167 1.10
fineweb_q08/duckdb:vortex-compact 🚨 609316197 449981746 1.35
duckdb / parquet (1.057x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1229112993 1151967063 1.07
fineweb_q01/duckdb:parquet 1556797889 1414325003 1.10
fineweb_q02/duckdb:parquet 1464223979 1399442291 1.05
fineweb_q03/duckdb:parquet 4264593693 3663980203 1.16
fineweb_q04/duckdb:parquet 2062103710 1973803713 1.04
fineweb_q05/duckdb:parquet 2260783929 2179323181 1.04
fineweb_q06/duckdb:parquet 4615636765 4549654216 1.01
fineweb_q07/duckdb:parquet 3018972055 2890969402 1.04
fineweb_q08/duckdb:parquet 1228654101 1229722586 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +69.0% +7.5% +57.2% +154.5% ➖ noise
0 datafusion:vortex-file-compressed +82.1% +7.5% +69.4% +209.7% ➖ noise
0 duckdb:vortex-compact +10.0% +7.5% +2.4% +38.1% ➖ noise
0 duckdb:vortex-file-compressed -16.2% +7.5% -22.0% +71.8% ➖ noise
1 datafusion:vortex-compact +121.1% +10.7% +99.7% +94.1% 🚨 regression
1 datafusion:vortex-file-compressed -13.1% +10.7% -21.4% +64.9% ➖ noise
1 duckdb:vortex-compact +20.2% +10.7% +8.6% +41.6% ➖ noise
1 duckdb:vortex-file-compressed -1.3% +10.7% -10.8% +30.0% ➖ noise
2 datafusion:vortex-compact -0.8% +14.0% -13.0% +43.9% ➖ noise
2 datafusion:vortex-file-compressed -47.0% +14.0% -53.5% +46.9% ✅ faster
2 duckdb:vortex-compact +20.9% +14.0% +6.0% +34.2% ➖ noise
2 duckdb:vortex-file-compressed +35.3% +14.0% +18.7% +33.1% ➖ noise
3 datafusion:vortex-compact +2.5% +10.6% -7.4% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -19.7% +10.6% -27.4% +30.0% ✅ faster
3 duckdb:vortex-compact +2.7% +10.6% -7.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +10.1% +10.6% -0.5% +30.0% ➖ noise
4 datafusion:vortex-compact +1.6% -3.9% +5.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -11.2% -3.9% -7.7% +30.0% ➖ noise
4 duckdb:vortex-compact +18.3% -3.9% +23.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -8.0% -3.9% -4.3% +34.6% ➖ noise
5 datafusion:vortex-compact -1.4% +16.8% -15.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.0% +16.8% -15.3% +30.0% ➖ noise
5 duckdb:vortex-compact +13.4% +16.8% -2.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +9.2% +16.8% -6.6% +38.8% ➖ noise
6 datafusion:vortex-compact -30.6% -3.2% -28.4% +30.0% ✅ faster
6 datafusion:vortex-file-compressed -36.2% -3.2% -34.2% +34.0% ✅ faster
6 duckdb:vortex-compact +16.0% -3.2% +19.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +0.1% -3.2% +3.3% +30.0% ➖ noise
7 datafusion:vortex-compact +0.9% +21.8% -17.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.1% +21.8% -17.1% +32.3% ➖ noise
7 duckdb:vortex-compact +9.6% +21.8% -10.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -1.4% +21.8% -19.1% +30.0% ➖ noise
8 datafusion:vortex-compact -26.3% +10.5% -33.3% +37.5% ✅ faster
8 datafusion:vortex-file-compressed -51.3% +10.5% -56.0% +67.8% ✅ faster
8 duckdb:vortex-compact +35.4% +10.5% +22.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -11.6% +10.5% -20.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): 0.982x ➖
Parquet (geomean): 0.984x ➖
Shifts: Parquet (control) -1.6% · Median polish -1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11863707 12559212 0.94
statpopgen_q01/duckdb:vortex-file-compressed 25857677 26637647 0.97
statpopgen_q02/duckdb:vortex-file-compressed 525912927 532081099 0.99
statpopgen_q03/duckdb:vortex-file-compressed 1067228137 1066117003 1.00
statpopgen_q04/duckdb:vortex-file-compressed 1056967770 1101560930 0.96
statpopgen_q05/duckdb:vortex-file-compressed 466394588 490228245 0.95
statpopgen_q06/duckdb:vortex-file-compressed 1531251873 1545096781 0.99
statpopgen_q07/duckdb:vortex-file-compressed 201585271 210807638 0.96
statpopgen_q08/duckdb:vortex-file-compressed 236908796 240140114 0.99
statpopgen_q09/duckdb:vortex-file-compressed 836558143 814864022 1.03
statpopgen_q10/duckdb:vortex-file-compressed 2556896575 2575763049 0.99
duckdb / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11524427 11644091 0.99
statpopgen_q01/duckdb:vortex-compact 211607157 216509661 0.98
statpopgen_q02/duckdb:vortex-compact 553793958 564674920 0.98
statpopgen_q03/duckdb:vortex-compact 1123067892 1176444356 0.95
statpopgen_q04/duckdb:vortex-compact 1155861387 1178354227 0.98
statpopgen_q05/duckdb:vortex-compact 570139984 571220735 1.00
statpopgen_q06/duckdb:vortex-compact 1484156230 1490639793 1.00
statpopgen_q07/duckdb:vortex-compact 869404542 893045472 0.97
statpopgen_q08/duckdb:vortex-compact 904478394 923609827 0.98
statpopgen_q09/duckdb:vortex-compact 926170188 921054051 1.01
statpopgen_q10/duckdb:vortex-compact 2589929109 2605035655 0.99
duckdb / parquet (0.984x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 292725939 305513565 0.96
statpopgen_q01/duckdb:parquet 383120820 386484504 0.99
statpopgen_q02/duckdb:parquet 749457318 762574974 0.98
statpopgen_q03/duckdb:parquet 1165854438 1192221008 0.98
statpopgen_q04/duckdb:parquet 1171847489 1184894681 0.99
statpopgen_q05/duckdb:parquet 816769094 818830606 1.00
statpopgen_q06/duckdb:parquet 1408554930 1417689577 0.99
statpopgen_q07/duckdb:parquet 843306419 860048514 0.98
statpopgen_q08/duckdb:parquet 851451521 875419938 0.97
statpopgen_q09/duckdb:parquet 1008520202 1037434223 0.97
statpopgen_q10/duckdb:parquet 2204198630 2179503480 1.01

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.0% -4.2% +3.3% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -5.5% -4.2% -1.4% +10.7% ➖ noise
1 duckdb:vortex-compact -2.3% -0.9% -1.4% +46.2% ➖ noise
1 duckdb:vortex-file-compressed -2.9% -0.9% -2.1% +222.4% ➖ noise
2 duckdb:vortex-compact -1.9% -1.7% -0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.2% -1.7% +0.6% +10.0% ➖ noise
3 duckdb:vortex-compact -4.5% -2.2% -2.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.1% -2.2% +2.4% +10.0% ➖ noise
4 duckdb:vortex-compact -1.9% -1.1% -0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.0% -1.1% -3.0% +10.0% ➖ noise
5 duckdb:vortex-compact -0.2% -0.3% +0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.9% -0.3% -4.6% +10.0% ➖ noise
6 duckdb:vortex-compact -0.4% -0.6% +0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.9% -0.6% -0.3% +10.0% ➖ noise
7 duckdb:vortex-compact -2.6% -1.9% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.4% -1.9% -2.5% +10.0% ➖ noise
8 duckdb:vortex-compact -2.1% -2.7% +0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.3% -2.7% +1.4% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% -2.8% +3.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.7% -2.8% +5.6% +10.0% ➖ noise
10 duckdb:vortex-compact -0.6% +1.1% -1.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% +1.1% -1.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Random Access

Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.013x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.038x ➖, 0↑ 1↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1672918 373248 4.48
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1067724 1039851 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8445653896 8341997582 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8298595301 8214764790 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 4273636 4522578 0.94
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 3861826 3836965 1.01
random-access/feature-vectors/uniform/lance-tokio-local-disk 1221762 1202008 1.02
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1875737 1869408 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8342054665 8179692236 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8448961729 8210072690 1.03
random-access/feature-vectors/uniform/vortex-tokio-local-disk 7324963 7139948 1.03
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 7112020 7011583 1.01
random-access/lance-tokio-local-disk 646564 638379 1.01
random-access/lance-tokio-local-disk-footer 1311806 1286078 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk 247759 245422 1.01
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 598884 596269 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 130016584 129424697 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129353994 130452409 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 612419 612158 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 637169 638223 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk 1028004 1034064 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1401799 1399265 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk 129530918 130348130 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129051176 130439571 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk 2186045 2148693 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2193242 2137551 1.03
random-access/nested-structs/correlated/lance-tokio-local-disk 379506 376411 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 569598 559387 1.02
random-access/nested-structs/correlated/parquet-tokio-local-disk 23687106 22772342 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 23618698 22406835 1.05
random-access/nested-structs/correlated/vortex-tokio-local-disk 784934 780474 1.01
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 805908 786845 1.02
random-access/nested-structs/uniform/lance-tokio-local-disk 2706061 2629513 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2866911 2771931 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk 23687577 22784714 1.04
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 23716767 22417025 1.06
random-access/nested-structs/uniform/vortex-tokio-local-disk 1706628 1625966 1.05
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1664051 1673334 0.99
random-access/parquet-tokio-local-disk 165800909 165303755 1.00
random-access/parquet-tokio-local-disk-footer 165648354 165328452 1.00
random-access/taxi/correlated/lance-tokio-local-disk 955910 927462 1.03
random-access/taxi/correlated/lance-tokio-local-disk-footer 1874088 1794083 1.04
random-access/taxi/correlated/parquet-tokio-local-disk 248981668 248395634 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 249254326 250736714 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 1633790 1755622 0.93
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1801145 1777831 1.01
random-access/taxi/uniform/lance-tokio-local-disk 9464178 9457536 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 10096707 10016148 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 266326521 266350396 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 265049164 267441013 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 4742661 4640821 1.02
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4682661 4631726 1.01
random-access/vortex-tokio-local-disk 1206536 1241433 0.97
random-access/vortex-tokio-local-disk-footer 1220447 1268070 0.96

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Engines: DataFusion No clear signal (+3.2%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): 1.028x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.035x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 407272095 401019173 1.02
tpch_q02/datafusion:vortex-file-compressed 115494778 109411920 1.06
tpch_q03/datafusion:vortex-file-compressed 223612427 215368953 1.04
tpch_q04/datafusion:vortex-file-compressed 117906343 114532929 1.03
tpch_q05/datafusion:vortex-file-compressed 401602045 382621275 1.05
tpch_q06/datafusion:vortex-file-compressed 37624983 38110711 0.99
tpch_q07/datafusion:vortex-file-compressed 528342636 516897786 1.02
tpch_q08/datafusion:vortex-file-compressed 388156811 376729977 1.03
tpch_q09/datafusion:vortex-file-compressed 667427898 649318672 1.03
tpch_q10/datafusion:vortex-file-compressed 241121730 232868552 1.04
tpch_q11/datafusion:vortex-file-compressed 90730764 86479717 1.05
tpch_q12/datafusion:vortex-file-compressed 123445357 117700911 1.05
tpch_q13/datafusion:vortex-file-compressed 227150992 221064628 1.03
tpch_q14/datafusion:vortex-file-compressed 54790024 52961383 1.03
tpch_q15/datafusion:vortex-file-compressed 106143254 100786042 1.05
tpch_q16/datafusion:vortex-file-compressed 82133654 78532389 1.05
tpch_q17/datafusion:vortex-file-compressed 683316712 643591040 1.06
tpch_q18/datafusion:vortex-file-compressed 913369478 879971229 1.04
tpch_q19/datafusion:vortex-file-compressed 80360191 77533974 1.04
tpch_q20/datafusion:vortex-file-compressed 170036693 164912779 1.03
tpch_q21/datafusion:vortex-file-compressed 707800210 673888401 1.05
tpch_q22/datafusion:vortex-file-compressed 68920832 68661600 1.00
datafusion / vortex-compact (1.044x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 460048307 453726653 1.01
tpch_q02/datafusion:vortex-compact 121959285 114443139 1.07
tpch_q03/datafusion:vortex-compact 231365104 217991838 1.06
tpch_q04/datafusion:vortex-compact 126702669 118941001 1.07
tpch_q05/datafusion:vortex-compact 406062998 387000327 1.05
tpch_q06/datafusion:vortex-compact 63506630 60592630 1.05
tpch_q07/datafusion:vortex-compact 557606547 529946449 1.05
tpch_q08/datafusion:vortex-compact 402916870 380306494 1.06
tpch_q09/datafusion:vortex-compact 685939271 660158767 1.04
tpch_q10/datafusion:vortex-compact 261636070 249822761 1.05
tpch_q11/datafusion:vortex-compact 92817615 88239518 1.05
tpch_q12/datafusion:vortex-compact 164275723 163091364 1.01
tpch_q13/datafusion:vortex-compact 277726153 273128007 1.02
tpch_q14/datafusion:vortex-compact 73147665 71603613 1.02
tpch_q15/datafusion:vortex-compact 162534751 157050715 1.03
tpch_q16/datafusion:vortex-compact 88772438 82990321 1.07
tpch_q17/datafusion:vortex-compact 704200114 644739175 1.09
tpch_q18/datafusion:vortex-compact 926672616 874304474 1.06
tpch_q19/datafusion:vortex-compact 128084673 126685449 1.01
tpch_q20/datafusion:vortex-compact 198300649 192079214 1.03
tpch_q21/datafusion:vortex-compact 719546334 680463657 1.06
tpch_q22/datafusion:vortex-compact 78835180 78312010 1.01
datafusion / parquet (0.993x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 452090528 446560176 1.01
tpch_q02/datafusion:parquet 177096774 178868968 0.99
tpch_q03/datafusion:parquet 282105787 287774916 0.98
tpch_q04/datafusion:parquet 129031916 126433602 1.02
tpch_q05/datafusion:parquet 433192864 439344401 0.99
tpch_q06/datafusion:parquet 124986979 135186269 0.92
tpch_q07/datafusion:parquet 607574214 607081991 1.00
tpch_q08/datafusion:parquet 467871419 469897710 1.00
tpch_q09/datafusion:parquet 750172058 764225980 0.98
tpch_q10/datafusion:parquet 509905598 512578781 0.99
tpch_q11/datafusion:parquet 122731145 120723676 1.02
tpch_q12/datafusion:parquet 197101476 205004999 0.96
tpch_q13/datafusion:parquet 331923445 331723976 1.00
tpch_q14/datafusion:parquet 152628867 164177373 0.93
tpch_q15/datafusion:parquet 257565765 254931451 1.01
tpch_q16/datafusion:parquet 129484286 129919360 1.00
tpch_q17/datafusion:parquet 697743719 691326119 1.01
tpch_q18/datafusion:parquet 917005325 909565365 1.01
tpch_q19/datafusion:parquet 263082247 255356544 1.03
tpch_q20/datafusion:parquet 292196799 293309915 1.00
tpch_q21/datafusion:parquet 716340661 703850172 1.02
tpch_q22/datafusion:parquet 221397194 224803381 0.98
datafusion / arrow (0.996x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 596110136 591229518 1.01
tpch_q02/datafusion:arrow 166822569 165952104 1.01
tpch_q03/datafusion:arrow 462775738 463753456 1.00
tpch_q04/datafusion:arrow 340505096 341221180 1.00
tpch_q05/datafusion:arrow 934732731 932907976 1.00
tpch_q06/datafusion:arrow 277869904 280624021 0.99
tpch_q07/datafusion:arrow 1176055910 1183549117 0.99
tpch_q08/datafusion:arrow 1159778125 1149451162 1.01
tpch_q09/datafusion:arrow 1358764947 1381168011 0.98
tpch_q10/datafusion:arrow 593166721 593364082 1.00
tpch_q11/datafusion:arrow 136957925 138932166 0.99
tpch_q12/datafusion:arrow 746914102 755921338 0.99
tpch_q13/datafusion:arrow 491764395 503198793 0.98
tpch_q14/datafusion:arrow 322951137 321418884 1.00
tpch_q15/datafusion:arrow 695012626 687589632 1.01
tpch_q16/datafusion:arrow 105909327 106061333 1.00
tpch_q17/datafusion:arrow 1315799306 1334222516 0.99
tpch_q18/datafusion:arrow 1905846623 1952429121 0.98
tpch_q19/datafusion:arrow 489049636 484136690 1.01
tpch_q20/datafusion:arrow 482146520 480542676 1.00
tpch_q21/datafusion:arrow 2978967696 3041940313 0.98
tpch_q22/datafusion:arrow 129097623 129752504 0.99
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 175081321 169174710 1.03
tpch_q02/duckdb:vortex-file-compressed 53623646 51209565 1.05
tpch_q03/duckdb:vortex-file-compressed 129707651 122758014 1.06
tpch_q04/duckdb:vortex-file-compressed 166988171 158837013 1.05
tpch_q05/duckdb:vortex-file-compressed 141652427 138066107 1.03
tpch_q06/duckdb:vortex-file-compressed 35873578 35536145 1.01
tpch_q07/duckdb:vortex-file-compressed 135677704 131941414 1.03
tpch_q08/duckdb:vortex-file-compressed 174656175 171329365 1.02
tpch_q09/duckdb:vortex-file-compressed 396800280 397339173 1.00
tpch_q10/duckdb:vortex-file-compressed 197391003 188382999 1.05
tpch_q11/duckdb:vortex-file-compressed 33533705 32507446 1.03
tpch_q12/duckdb:vortex-file-compressed 103462083 101171074 1.02
tpch_q13/duckdb:vortex-file-compressed 277154097 270235382 1.03
tpch_q14/duckdb:vortex-file-compressed 54922399 53237061 1.03
tpch_q15/duckdb:vortex-file-compressed 88702780 88612724 1.00
tpch_q16/duckdb:vortex-file-compressed 78822820 78304851 1.01
tpch_q17/duckdb:vortex-file-compressed 95041169 94071737 1.01
tpch_q18/duckdb:vortex-file-compressed 292999847 282521354 1.04
tpch_q19/duckdb:vortex-file-compressed 82151289 79241441 1.04
tpch_q20/duckdb:vortex-file-compressed 143173007 141288182 1.01
tpch_q21/duckdb:vortex-file-compressed 531348170 483241234 1.10
tpch_q22/duckdb:vortex-file-compressed 65528279 63693901 1.03
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231521914 229000100 1.01
tpch_q02/duckdb:vortex-compact 58258459 55871908 1.04
tpch_q03/duckdb:vortex-compact 136516794 136218754 1.00
tpch_q04/duckdb:vortex-compact 171877001 170719441 1.01
tpch_q05/duckdb:vortex-compact 165616617 166563372 0.99
tpch_q06/duckdb:vortex-compact 58965742 55506079 1.06
tpch_q07/duckdb:vortex-compact 172145103 171993122 1.00
tpch_q08/duckdb:vortex-compact 189979312 189419250 1.00
tpch_q09/duckdb:vortex-compact 426160221 424790659 1.00
tpch_q10/duckdb:vortex-compact 220594548 218820463 1.01
tpch_q11/duckdb:vortex-compact 38597130 39169947 0.99
tpch_q12/duckdb:vortex-compact 163471082 164358374 0.99
tpch_q13/duckdb:vortex-compact 325034015 324384619 1.00
tpch_q14/duckdb:vortex-compact 72512049 72205885 1.00
tpch_q15/duckdb:vortex-compact 114223207 116431503 0.98
tpch_q16/duckdb:vortex-compact 81979035 79989932 1.02
tpch_q17/duckdb:vortex-compact 106911499 106530009 1.00
tpch_q18/duckdb:vortex-compact 290895878 288640120 1.01
tpch_q19/duckdb:vortex-compact 96748957 96771944 1.00
tpch_q20/duckdb:vortex-compact 177332062 178825750 0.99
tpch_q21/duckdb:vortex-compact 520065623 517775002 1.00
tpch_q22/duckdb:vortex-compact 71257462 72876721 0.98
duckdb / parquet (1.021x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 270983935 261817557 1.04
tpch_q02/duckdb:parquet 99990543 104424189 0.96
tpch_q03/duckdb:parquet 214670101 210895387 1.02
tpch_q04/duckdb:parquet 140320262 134986556 1.04
tpch_q05/duckdb:parquet 233675603 226410209 1.03
tpch_q06/duckdb:parquet 76640100 73629380 1.04
tpch_q07/duckdb:parquet 192804402 188999051 1.02
tpch_q08/duckdb:parquet 273595310 260035132 1.05
tpch_q09/duckdb:parquet 488589487 473967309 1.03
tpch_q10/duckdb:parquet 632911650 623522201 1.02
tpch_q11/duckdb:parquet 66322571 62648955 1.06
tpch_q12/duckdb:parquet 136420000 131637982 1.04
tpch_q13/duckdb:parquet 409044610 435674634 0.94
tpch_q14/duckdb:parquet 183310585 180622568 1.01
tpch_q15/duckdb:parquet 105977853 104912507 1.01
tpch_q16/duckdb:parquet 167055037 160814287 1.04
tpch_q17/duckdb:parquet 186233592 181534859 1.03
tpch_q18/duckdb:parquet 368303401 370019209 1.00
tpch_q19/duckdb:parquet 287082102 281727251 1.02
tpch_q20/duckdb:parquet 232015860 230600684 1.01
tpch_q21/duckdb:parquet 592723680 555477045 1.07
tpch_q22/duckdb:parquet 296692168 293568048 1.01
duckdb / duckdb (1.002x ➖, 0↑ 0↓)
name PR 70c91be (ns) base c005aae (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119517823 120735876 0.99
tpch_q02/duckdb:duckdb 49384982 49166290 1.00
tpch_q03/duckdb:duckdb 103633893 103615475 1.00
tpch_q04/duckdb:duckdb 138754550 138153427 1.00
tpch_q05/duckdb:duckdb 119473916 119381129 1.00
tpch_q06/duckdb:duckdb 44689452 44744448 1.00
tpch_q07/duckdb:duckdb 91915691 91651417 1.00
tpch_q08/duckdb:duckdb 118551482 118012920 1.00
tpch_q09/duckdb:duckdb 280639010 277916739 1.01
tpch_q10/duckdb:duckdb 213759053 212254007 1.01
tpch_q11/duckdb:duckdb 19967997 19384583 1.03
tpch_q12/duckdb:duckdb 90586447 90449386 1.00
tpch_q13/duckdb:duckdb 234580090 231076705 1.02
tpch_q14/duckdb:duckdb 78134920 77726740 1.01
tpch_q15/duckdb:duckdb 82037969 82256984 1.00
tpch_q16/duckdb:duckdb 76130499 76065599 1.00
tpch_q17/duckdb:duckdb 87799815 87988086 1.00
tpch_q18/duckdb:duckdb 237731947 234134921 1.02
tpch_q19/duckdb:duckdb 124457846 124379343 1.00
tpch_q20/duckdb:duckdb 118294566 118142857 1.00
tpch_q21/duckdb:duckdb 305969072 303418273 1.01
tpch_q22/duckdb:duckdb 68443635 71438121 0.96

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.8% +2.4% -1.5% +10.0% ➖ noise
1 datafusion:vortex-compact +1.4% +2.4% -0.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +1.6% +2.4% -0.8% +10.0% ➖ noise
1 duckdb:duckdb -1.0% +2.4% -3.3% +10.0% ➖ noise
1 duckdb:vortex-compact +1.1% +2.4% -1.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +3.5% +2.4% +1.1% +10.0% ➖ noise
2 datafusion:arrow +0.5% -2.6% +3.2% +10.0% ➖ noise
2 datafusion:vortex-compact +6.6% -2.6% +9.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.6% -2.6% +8.4% +10.0% ➖ noise
2 duckdb:duckdb +0.4% -2.6% +3.2% +10.0% ➖ noise
2 duckdb:vortex-compact +4.3% -2.6% +7.1% +14.7% ➖ noise
2 duckdb:vortex-file-compressed +4.7% -2.6% +7.5% +11.6% ➖ noise
3 datafusion:arrow -0.2% -0.1% -0.1% +10.0% ➖ noise
3 datafusion:vortex-compact +6.1% -0.1% +6.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.8% -0.1% +3.9% +10.0% ➖ noise
3 duckdb:duckdb +0.0% -0.1% +0.1% +10.0% ➖ noise
3 duckdb:vortex-compact +0.2% -0.1% +0.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.7% -0.1% +5.8% +10.0% ➖ noise
4 datafusion:arrow -0.2% +3.0% -3.1% +10.0% ➖ noise
4 datafusion:vortex-compact +6.5% +3.0% +3.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.9% +3.0% -0.1% +10.0% ➖ noise
4 duckdb:duckdb +0.4% +3.0% -2.5% +10.0% ➖ noise
4 duckdb:vortex-compact +0.7% +3.0% -2.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +5.1% +3.0% +2.1% +10.0% ➖ noise
5 datafusion:arrow +0.2% +0.9% -0.7% +10.0% ➖ noise
5 datafusion:vortex-compact +4.9% +0.9% +4.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.0% +0.9% +4.0% +10.0% ➖ noise
5 duckdb:duckdb +0.1% +0.9% -0.8% +10.0% ➖ noise
5 duckdb:vortex-compact -0.6% +0.9% -1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.6% +0.9% +1.7% +10.0% ➖ noise
6 datafusion:arrow -1.0% -1.9% +0.9% +10.0% ➖ noise
6 datafusion:vortex-compact +4.8% -1.9% +6.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.3% -1.9% +0.6% +10.0% ➖ noise
6 duckdb:duckdb -0.1% -1.9% +1.8% +10.0% ➖ noise
6 duckdb:vortex-compact +6.2% -1.9% +8.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.9% -1.9% +2.9% +14.9% ➖ noise
7 datafusion:arrow -0.6% +1.0% -1.7% +10.0% ➖ noise
7 datafusion:vortex-compact +5.2% +1.0% +4.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.2% +1.0% +1.2% +10.0% ➖ noise
7 duckdb:duckdb +0.3% +1.0% -0.7% +10.0% ➖ noise
7 duckdb:vortex-compact +0.1% +1.0% -0.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.8% +1.0% +1.8% +10.0% ➖ noise
8 datafusion:arrow +0.9% +2.4% -1.4% +10.0% ➖ noise
8 datafusion:vortex-compact +5.9% +2.4% +3.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +3.0% +2.4% +0.7% +10.0% ➖ noise
8 duckdb:duckdb +0.5% +2.4% -1.9% +10.0% ➖ noise
8 duckdb:vortex-compact +0.3% +2.4% -2.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.9% +2.4% -0.4% +10.0% ➖ noise
9 datafusion:arrow -1.6% +0.6% -2.2% +10.0% ➖ noise
9 datafusion:vortex-compact +3.9% +0.6% +3.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.8% +0.6% +2.2% +10.0% ➖ noise
9 duckdb:duckdb +1.0% +0.6% +0.4% +10.0% ➖ noise
9 duckdb:vortex-compact +0.3% +0.6% -0.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.1% +0.6% -0.7% +10.0% ➖ noise
10 datafusion:arrow -0.0% +0.5% -0.5% +10.0% ➖ noise
10 datafusion:vortex-compact +4.7% +0.5% +4.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.5% +0.5% +3.0% +10.0% ➖ noise
10 duckdb:duckdb +0.7% +0.5% +0.2% +10.0% ➖ noise
10 duckdb:vortex-compact +0.8% +0.5% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.8% +0.5% +4.3% +10.0% ➖ noise
11 datafusion:arrow -1.4% +3.7% -5.0% +12.1% ➖ noise
11 datafusion:vortex-compact +5.2% +3.7% +1.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.9% +3.7% +1.1% +10.0% ➖ noise
11 duckdb:duckdb +3.0% +3.7% -0.7% +10.0% ➖ noise
11 duckdb:vortex-compact -1.5% +3.7% -5.0% +13.3% ➖ noise
11 duckdb:vortex-file-compressed +3.2% +3.7% -0.6% +14.8% ➖ noise
12 datafusion:arrow -1.2% -0.2% -1.0% +36.4% ➖ noise
12 datafusion:vortex-compact +0.7% -0.2% +0.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.9% -0.2% +5.1% +10.0% ➖ noise
12 duckdb:duckdb +0.2% -0.2% +0.3% +10.0% ➖ noise
12 duckdb:vortex-compact -0.5% -0.2% -0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.3% -0.2% +2.5% +10.0% ➖ noise
13 datafusion:arrow -2.3% -3.1% +0.8% +10.0% ➖ noise
13 datafusion:vortex-compact +1.7% -3.1% +4.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.8% -3.1% +6.0% +10.0% ➖ noise
13 duckdb:duckdb +1.5% -3.1% +4.7% +10.0% ➖ noise
13 duckdb:vortex-compact +0.2% -3.1% +3.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.6% -3.1% +5.8% +10.0% ➖ noise
14 datafusion:arrow +0.5% -2.9% +3.4% +10.0% ➖ noise
14 datafusion:vortex-compact +2.2% -2.9% +5.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +3.5% -2.9% +6.5% +10.0% ➖ noise
14 duckdb:duckdb +0.5% -2.9% +3.5% +10.0% ➖ noise
14 duckdb:vortex-compact +0.4% -2.9% +3.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +3.2% -2.9% +6.2% +10.0% ➖ noise
15 datafusion:arrow +1.1% +1.0% +0.1% +10.0% ➖ noise
15 datafusion:vortex-compact +3.5% +1.0% +2.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +5.3% +1.0% +4.2% +10.0% ➖ noise
15 duckdb:duckdb -0.3% +1.0% -1.3% +10.0% ➖ noise
15 duckdb:vortex-compact -1.9% +1.0% -2.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.1% +1.0% -0.9% +10.0% ➖ noise
16 datafusion:arrow -0.1% +1.8% -1.9% +10.0% ➖ noise
16 datafusion:vortex-compact +7.0% +1.8% +5.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +4.6% +1.8% +2.8% +10.0% ➖ noise
16 duckdb:duckdb +0.1% +1.8% -1.6% +10.0% ➖ noise
16 duckdb:vortex-compact +2.5% +1.8% +0.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.7% +1.8% -1.1% +10.0% ➖ noise
17 datafusion:arrow -1.4% +1.8% -3.1% +10.0% ➖ noise
17 datafusion:vortex-compact +9.2% +1.8% +7.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +6.2% +1.8% +4.3% +10.0% ➖ noise
17 duckdb:duckdb -0.2% +1.8% -1.9% +10.0% ➖ noise
17 duckdb:vortex-compact +0.4% +1.8% -1.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.0% +1.8% -0.7% +10.0% ➖ noise
18 datafusion:arrow -2.4% +0.2% -2.6% +10.0% ➖ noise
18 datafusion:vortex-compact +6.0% +0.2% +5.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.8% +0.2% +3.6% +10.0% ➖ noise
18 duckdb:duckdb +1.5% +0.2% +1.4% +10.0% ➖ noise
18 duckdb:vortex-compact +0.8% +0.2% +0.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.7% +0.2% +3.5% +10.0% ➖ noise
19 datafusion:arrow +1.0% +2.5% -1.4% +10.0% ➖ noise
19 datafusion:vortex-compact +1.1% +2.5% -1.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +3.6% +2.5% +1.2% +10.0% ➖ noise
19 duckdb:duckdb +0.1% +2.5% -2.3% +10.0% ➖ noise
19 duckdb:vortex-compact -0.0% +2.5% -2.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +3.7% +2.5% +1.2% +10.0% ➖ noise
20 datafusion:arrow +0.3% +0.1% +0.2% +10.0% ➖ noise
20 datafusion:vortex-compact +3.2% +0.1% +3.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.1% +0.1% +3.0% +10.0% ➖ noise
20 duckdb:duckdb +0.1% +0.1% +0.0% +10.0% ➖ noise
20 duckdb:vortex-compact -0.8% +0.1% -1.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.3% +0.1% +1.2% +10.0% ➖ noise
21 datafusion:arrow -2.1% +4.2% -6.0% +10.0% ➖ noise
21 datafusion:vortex-compact +5.7% +4.2% +1.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +5.0% +4.2% +0.8% +10.0% ➖ noise
21 duckdb:duckdb +0.8% +4.2% -3.2% +10.0% ➖ noise
21 duckdb:vortex-compact +0.4% +4.2% -3.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +10.0% +4.2% +5.5% +10.0% ➖ noise
22 datafusion:arrow -0.5% -0.2% -0.3% +10.0% ➖ noise
22 datafusion:vortex-compact +0.7% -0.2% +0.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.4% -0.2% +0.6% +10.0% ➖ noise
22 duckdb:duckdb -4.2% -0.2% -4.0% +10.0% ➖ noise
22 duckdb:vortex-compact -2.2% -0.2% -2.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +2.9% -0.2% +3.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-1.2%, low confidence) · DuckDB No clear signal (+0.8%, environment too noisy confidence)
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.970x ➖
Shifts: Parquet (control) -3.0% · Median polish -2.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.956x ➖, 8↑ 1↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2076918 1733398 1.20
clickbench_q01/datafusion:vortex-file-compressed 19068811 17518611 1.09
clickbench_q02/datafusion:vortex-file-compressed 40584976 39472218 1.03
clickbench_q03/datafusion:vortex-file-compressed 44739236 44318312 1.01
clickbench_q04/datafusion:vortex-file-compressed 286202169 294391774 0.97
clickbench_q05/datafusion:vortex-file-compressed 315250327 327044281 0.96
clickbench_q06/datafusion:vortex-file-compressed 🚀 1603095 1889659 0.85
clickbench_q07/datafusion:vortex-file-compressed 22654160 20823748 1.09
clickbench_q08/datafusion:vortex-file-compressed 358669539 379480878 0.95
clickbench_q09/datafusion:vortex-file-compressed 560724831 603246401 0.93
clickbench_q10/datafusion:vortex-file-compressed 78881132 77397051 1.02
clickbench_q11/datafusion:vortex-file-compressed 86582825 90962547 0.95
clickbench_q12/datafusion:vortex-file-compressed 274868799 279530531 0.98
clickbench_q13/datafusion:vortex-file-compressed 427645408 452922424 0.94
clickbench_q14/datafusion:vortex-file-compressed 265661418 277731724 0.96
clickbench_q15/datafusion:vortex-file-compressed 334998093 349127582 0.96
clickbench_q16/datafusion:vortex-file-compressed 664266576 697399446 0.95
clickbench_q17/datafusion:vortex-file-compressed 652705775 698733039 0.93
clickbench_q18/datafusion:vortex-file-compressed 1345099713 1444544137 0.93
clickbench_q19/datafusion:vortex-file-compressed 33360143 33153883 1.01
clickbench_q20/datafusion:vortex-file-compressed 352927842 359997480 0.98
clickbench_q21/datafusion:vortex-file-compressed 379890196 395821719 0.96
clickbench_q22/datafusion:vortex-file-compressed 462966816 475748975 0.97
clickbench_q23/datafusion:vortex-file-compressed 693696392 676086974 1.03
clickbench_q24/datafusion:vortex-file-compressed 45940514 47156737 0.97
clickbench_q25/datafusion:vortex-file-compressed 74595113 81635264 0.91
clickbench_q26/datafusion:vortex-file-compressed 45601470 49900211 0.91
clickbench_q27/datafusion:vortex-file-compressed 752513847 773909876 0.97
clickbench_q28/datafusion:vortex-file-compressed 6740859856 6747806279 1.00
clickbench_q29/datafusion:vortex-file-compressed 252233653 230731441 1.09
clickbench_q30/datafusion:vortex-file-compressed 227073594 239164485 0.95
clickbench_q31/datafusion:vortex-file-compressed 262138188 270914100 0.97
clickbench_q32/datafusion:vortex-file-compressed 1147105287 1241634955 0.92
clickbench_q33/datafusion:vortex-file-compressed 1378005677 1462515798 0.94
clickbench_q34/datafusion:vortex-file-compressed 🚀 1364251680 1526718873 0.89
clickbench_q35/datafusion:vortex-file-compressed 469566174 516634167 0.91
clickbench_q36/datafusion:vortex-file-compressed 🚀 73346587 91097020 0.81
clickbench_q37/datafusion:vortex-file-compressed 37047622 40677696 0.91
clickbench_q38/datafusion:vortex-file-compressed 🚀 18979335 21170359 0.90
clickbench_q39/datafusion:vortex-file-compressed 🚀 139298804 158059488 0.88
clickbench_q40/datafusion:vortex-file-compressed 🚀 16008509 18019146 0.89
clickbench_q41/datafusion:vortex-file-compressed 🚀 14648889 17046987 0.86
clickbench_q42/datafusion:vortex-file-compressed 🚀 17160812 19429950 0.88
datafusion / parquet (0.968x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1584504 1602296 0.99
clickbench_q01/datafusion:parquet 19047421 20927933 0.91
clickbench_q02/datafusion:parquet 45192348 47237995 0.96
clickbench_q03/datafusion:parquet 36760529 37554848 0.98
clickbench_q04/datafusion:parquet 301154194 317155940 0.95
clickbench_q05/datafusion:parquet 348890458 361215192 0.97
clickbench_q06/datafusion:parquet 1544593 1653172 0.93
clickbench_q07/datafusion:parquet 22578194 24405890 0.93
clickbench_q08/datafusion:parquet 377655181 378374374 1.00
clickbench_q09/datafusion:parquet 615431929 623778976 0.99
clickbench_q10/datafusion:parquet 107799814 108681392 0.99
clickbench_q11/datafusion:parquet 131220387 130400787 1.01
clickbench_q12/datafusion:parquet 350085364 353178218 0.99
clickbench_q13/datafusion:parquet 500269555 502833619 0.99
clickbench_q14/datafusion:parquet 343220436 351399768 0.98
clickbench_q15/datafusion:parquet 342621530 345093066 0.99
clickbench_q16/datafusion:parquet 667940150 678420703 0.98
clickbench_q17/datafusion:parquet 659660105 660209043 1.00
clickbench_q18/datafusion:parquet 1346993976 1369057124 0.98
clickbench_q19/datafusion:parquet 30090028 30122350 1.00
clickbench_q20/datafusion:parquet 600988268 611346604 0.98
clickbench_q21/datafusion:parquet 650745280 682121670 0.95
clickbench_q22/datafusion:parquet 966542669 1012577423 0.95
clickbench_q23/datafusion:parquet 3715217423 3859335416 0.96
clickbench_q24/datafusion:parquet 87582335 84076208 1.04
clickbench_q25/datafusion:parquet 133031429 136585833 0.97
clickbench_q26/datafusion:parquet 88495257 83269652 1.06
clickbench_q27/datafusion:parquet 1048733156 1109324222 0.95
clickbench_q28/datafusion:parquet 6595937338 6793473386 0.97
clickbench_q29/datafusion:parquet 238448236 231252856 1.03
clickbench_q30/datafusion:parquet 333370532 352187251 0.95
clickbench_q31/datafusion:parquet 375794705 391595219 0.96
clickbench_q32/datafusion:parquet 1229642241 1323465454 0.93
clickbench_q33/datafusion:parquet 1471035802 1578980998 0.93
clickbench_q34/datafusion:parquet 1525791357 1588715675 0.96
clickbench_q35/datafusion:parquet 455903979 505927453 0.90
clickbench_q36/datafusion:parquet 145602294 157667922 0.92
clickbench_q37/datafusion:parquet 58361128 58481891 1.00
clickbench_q38/datafusion:parquet 86520951 88822830 0.97
clickbench_q39/datafusion:parquet 270874950 283584027 0.96
clickbench_q40/datafusion:parquet 30463314 32659321 0.93
clickbench_q41/datafusion:parquet 27273015 29990667 0.91
clickbench_q42/datafusion:parquet 29267628 30923546 0.95
duckdb / vortex-file-compressed (0.980x ➖, 4↑ 1↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6830071 6695354 1.02
clickbench_q01/duckdb:vortex-file-compressed 11921882 11431436 1.04
clickbench_q02/duckdb:vortex-file-compressed 24684902 26404982 0.93
clickbench_q03/duckdb:vortex-file-compressed 30124313 31757068 0.95
clickbench_q04/duckdb:vortex-file-compressed 187387621 187431848 1.00
clickbench_q05/duckdb:vortex-file-compressed 🚀 170349736 192899591 0.88
clickbench_q06/duckdb:vortex-file-compressed 🚀 20103238 25469303 0.79
clickbench_q07/duckdb:vortex-file-compressed 16314207 16512458 0.99
clickbench_q08/duckdb:vortex-file-compressed 🚀 265114869 304127520 0.87
clickbench_q09/duckdb:vortex-file-compressed 339528335 354747815 0.96
clickbench_q10/duckdb:vortex-file-compressed 68590847 67776892 1.01
clickbench_q11/duckdb:vortex-file-compressed 78586389 78499834 1.00
clickbench_q12/duckdb:vortex-file-compressed 197448529 195953025 1.01
clickbench_q13/duckdb:vortex-file-compressed 405218256 408785899 0.99
clickbench_q14/duckdb:vortex-file-compressed 228227653 229626067 0.99
clickbench_q15/duckdb:vortex-file-compressed 242393139 243334631 1.00
clickbench_q16/duckdb:vortex-file-compressed 525969601 538887667 0.98
clickbench_q17/duckdb:vortex-file-compressed 419740443 420726294 1.00
clickbench_q18/duckdb:vortex-file-compressed 939282274 956423163 0.98
clickbench_q19/duckdb:vortex-file-compressed 20853280 22111034 0.94
clickbench_q20/duckdb:vortex-file-compressed 333496795 336243163 0.99
clickbench_q21/duckdb:vortex-file-compressed 379769710 374177928 1.01
clickbench_q22/duckdb:vortex-file-compressed 520998040 530178863 0.98
clickbench_q23/duckdb:vortex-file-compressed 209330209 211828094 0.99
clickbench_q24/duckdb:vortex-file-compressed 35712252 36717572 0.97
clickbench_q25/duckdb:vortex-file-compressed 75667673 70318388 1.08
clickbench_q26/duckdb:vortex-file-compressed 46394915 45119493 1.03
clickbench_q27/duckdb:vortex-file-compressed 497984009 486282217 1.02
clickbench_q28/duckdb:vortex-file-compressed 3033723913 3061957118 0.99
clickbench_q29/duckdb:vortex-file-compressed 🚨 35037187 28908854 1.21
clickbench_q30/duckdb:vortex-file-compressed 193386899 198909482 0.97
clickbench_q31/duckdb:vortex-file-compressed 284892685 293860862 0.97
clickbench_q32/duckdb:vortex-file-compressed 1116517750 1125340851 0.99
clickbench_q33/duckdb:vortex-file-compressed 🚀 1055168731 1190165062 0.89
clickbench_q34/duckdb:vortex-file-compressed 1161892982 1169992171 0.99
clickbench_q35/duckdb:vortex-file-compressed 376521627 377604522 1.00
clickbench_q36/duckdb:vortex-file-compressed 27337295 27527162 0.99
clickbench_q37/duckdb:vortex-file-compressed 19406114 20906827 0.93
clickbench_q38/duckdb:vortex-file-compressed 20669233 20921276 0.99
clickbench_q39/duckdb:vortex-file-compressed 39442577 41443300 0.95
clickbench_q40/duckdb:vortex-file-compressed 19840537 19471873 1.02
clickbench_q41/duckdb:vortex-file-compressed 20303204 20255080 1.00
clickbench_q42/duckdb:vortex-file-compressed 19256639 21024240 0.92
duckdb / parquet (0.972x ➖, 2↑ 1↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22051609 22236976 0.99
clickbench_q01/duckdb:parquet 29270364 29679710 0.99
clickbench_q02/duckdb:parquet 50349741 50767190 0.99
clickbench_q03/duckdb:parquet 40324927 40400125 1.00
clickbench_q04/duckdb:parquet 204489575 207577239 0.99
clickbench_q05/duckdb:parquet 259968898 261298580 0.99
clickbench_q06/duckdb:parquet 46973809 48958619 0.96
clickbench_q07/duckdb:parquet 32138364 32309624 0.99
clickbench_q08/duckdb:parquet 268291005 287458231 0.93
clickbench_q09/duckdb:parquet 401440182 438081885 0.92
clickbench_q10/duckdb:parquet 82347803 87634021 0.94
clickbench_q11/duckdb:parquet 98970241 106056005 0.93
clickbench_q12/duckdb:parquet 281303100 304370764 0.92
clickbench_q13/duckdb:parquet 470800425 517345257 0.91
clickbench_q14/duckdb:parquet 312134206 345066402 0.90
clickbench_q15/duckdb:parquet 255640294 276829360 0.92
clickbench_q16/duckdb:parquet 594711842 657857110 0.90
clickbench_q17/duckdb:parquet 496777261 543014639 0.91
clickbench_q18/duckdb:parquet 🚀 1035754371 1164257388 0.89
clickbench_q19/duckdb:parquet 27242534 29488477 0.92
clickbench_q20/duckdb:parquet 411110792 447607725 0.92
clickbench_q21/duckdb:parquet 🚀 529245587 593819397 0.89
clickbench_q22/duckdb:parquet 926623331 937180621 0.99
clickbench_q23/duckdb:parquet 261876897 272762140 0.96
clickbench_q24/duckdb:parquet 69066127 70207041 0.98
clickbench_q25/duckdb:parquet 163824315 166130665 0.99
clickbench_q26/duckdb:parquet 56896680 54849834 1.04
clickbench_q27/duckdb:parquet 645301676 647995207 1.00
clickbench_q28/duckdb:parquet 4863650171 4895548291 0.99
clickbench_q29/duckdb:parquet 42104895 42927887 0.98
clickbench_q30/duckdb:parquet 310975221 315246557 0.99
clickbench_q31/duckdb:parquet 376838229 376705569 1.00
clickbench_q32/duckdb:parquet 1107166646 1119538510 0.99
clickbench_q33/duckdb:parquet 1103580419 1120779078 0.98
clickbench_q34/duckdb:parquet 1154117048 1168329005 0.99
clickbench_q35/duckdb:parquet 370541193 372506405 0.99
clickbench_q36/duckdb:parquet 45142868 46070827 0.98
clickbench_q37/duckdb:parquet 34219754 34562259 0.99
clickbench_q38/duckdb:parquet 35587418 35186380 1.01
clickbench_q39/duckdb:parquet 🚨 89484952 76285744 1.17
clickbench_q40/duckdb:parquet 20985690 21127591 0.99
clickbench_q41/duckdb:parquet 21838091 21307938 1.02
clickbench_q42/duckdb:parquet 24021060 22317119 1.08
duckdb / duckdb (0.980x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17060588 17790621 0.96
clickbench_q01/duckdb:duckdb 34015487 35015732 0.97
clickbench_q02/duckdb:duckdb 50716306 52399544 0.97
clickbench_q03/duckdb:duckdb 55352770 55866991 0.99
clickbench_q04/duckdb:duckdb 209558067 213164435 0.98
clickbench_q05/duckdb:duckdb 283026399 289025065 0.98
clickbench_q06/duckdb:duckdb 34069754 35290000 0.97
clickbench_q07/duckdb:duckdb 34788343 35741369 0.97
clickbench_q08/duckdb:duckdb 267937175 276411161 0.97
clickbench_q09/duckdb:duckdb 392265298 405688691 0.97
clickbench_q10/duckdb:duckdb 116839358 118407077 0.99
clickbench_q11/duckdb:duckdb 126977528 128878146 0.99
clickbench_q12/duckdb:duckdb 257033041 261466057 0.98
clickbench_q13/duckdb:duckdb 447703476 456408809 0.98
clickbench_q14/duckdb:duckdb 283639393 287532755 0.99
clickbench_q15/duckdb:duckdb 240334086 245188651 0.98
clickbench_q16/duckdb:duckdb 558869439 573430576 0.97
clickbench_q17/duckdb:duckdb 473464950 483082875 0.98
clickbench_q18/duckdb:duckdb 992003673 1052310364 0.94
clickbench_q19/duckdb:duckdb 35596362 34665305 1.03
clickbench_q20/duckdb:duckdb 466737582 478379553 0.98
clickbench_q21/duckdb:duckdb 474195692 483598303 0.98
clickbench_q22/duckdb:duckdb 547497032 531126367 1.03
clickbench_q23/duckdb:duckdb 245943604 257883036 0.95
clickbench_q24/duckdb:duckdb 62145704 62231085 1.00
clickbench_q25/duckdb:duckdb 149081240 150348039 0.99
clickbench_q26/duckdb:duckdb 62414826 63144751 0.99
clickbench_q27/duckdb:duckdb 552898880 561355494 0.98
clickbench_q28/duckdb:duckdb 4540147150 4504545899 1.01
clickbench_q29/duckdb:duckdb 50477698 50546689 1.00
clickbench_q30/duckdb:duckdb 280029181 279973426 1.00
clickbench_q31/duckdb:duckdb 366174676 369921215 0.99
clickbench_q32/duckdb:duckdb 1118585523 1156243069 0.97
clickbench_q33/duckdb:duckdb 1110931481 1162055182 0.96
clickbench_q34/duckdb:duckdb 1192244787 1232670130 0.97
clickbench_q35/duckdb:duckdb 304414275 304236582 1.00
clickbench_q36/duckdb:duckdb 49346082 50810585 0.97
clickbench_q37/duckdb:duckdb 28808957 29170292 0.99
clickbench_q38/duckdb:duckdb 34226407 33871602 1.01
clickbench_q39/duckdb:duckdb 79463898 84428446 0.94
clickbench_q40/duckdb:duckdb 27689792 28650372 0.97
clickbench_q41/duckdb:duckdb 26834020 27754190 0.97
clickbench_q42/duckdb:duckdb 29017408 30323012 0.96
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.04 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +19.8% -1.0% +21.0% +714.9% ➖ noise
0 duckdb:duckdb -4.1% -1.0% -3.2% +277.5% ➖ noise
0 duckdb:vortex-file-compressed +2.0% -1.0% +3.0% +460.3% ➖ noise
1 datafusion:vortex-file-compressed +8.8% -5.3% +14.9% +25.0% ➖ noise
1 duckdb:duckdb -2.9% -5.3% +2.5% +44.7% ➖ noise
1 duckdb:vortex-file-compressed +4.3% -5.3% +10.1% +24.5% ➖ noise
2 datafusion:vortex-file-compressed +2.8% -2.6% +5.6% +10.0% ➖ noise
2 duckdb:duckdb -3.2% -2.6% -0.6% +23.2% ➖ noise
2 duckdb:vortex-file-compressed -6.5% -2.6% -4.0% +12.1% ➖ noise
3 datafusion:vortex-file-compressed +0.9% -1.2% +2.1% +159.9% ➖ noise
3 duckdb:duckdb -0.9% -1.2% +0.2% +74.2% ➖ noise
3 duckdb:vortex-file-compressed -5.1% -1.2% -4.0% +80.8% ➖ noise
4 datafusion:vortex-file-compressed -2.8% -3.3% +0.5% +10.0% ➖ noise
4 duckdb:duckdb -1.7% -3.3% +1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.0% -3.3% +3.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.6% -2.0% -1.7% +10.0% ➖ noise
5 duckdb:duckdb -2.1% -2.0% -0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -11.7% -2.0% -9.9% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -15.2% -5.3% -10.4% +42.1% ➖ noise
6 duckdb:duckdb -3.5% -5.3% +2.0% +15.1% ➖ noise
6 duckdb:vortex-file-compressed -21.1% -5.3% -16.6% +19.2% ✅ faster
7 datafusion:vortex-file-compressed +8.8% -4.1% +13.4% +24.9% ➖ noise
7 duckdb:duckdb -2.7% -4.1% +1.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.2% -4.1% +3.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.5% -3.5% -2.1% +10.0% ➖ noise
8 duckdb:duckdb -3.1% -3.5% +0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -12.8% -3.5% -9.7% +10.0% ✅ faster
9 datafusion:vortex-file-compressed -7.0% -4.9% -2.2% +10.0% ➖ noise
9 duckdb:duckdb -3.3% -4.9% +1.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.3% -4.9% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.9% -3.5% +5.6% +10.0% ➖ noise
10 duckdb:duckdb -1.3% -3.5% +2.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.2% -3.5% +4.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -4.8% -3.1% -1.8% +10.0% ➖ noise
11 duckdb:duckdb -1.5% -3.1% +1.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.1% -3.1% +3.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.7% -4.3% +2.7% +10.0% ➖ noise
12 duckdb:duckdb -1.7% -4.3% +2.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.8% -4.3% +5.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -5.6% -4.8% -0.8% +10.0% ➖ noise
13 duckdb:duckdb -1.9% -4.8% +3.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.9% -4.8% +4.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -4.3% -6.0% +1.8% +10.0% ➖ noise
14 duckdb:duckdb -1.4% -6.0% +4.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.6% -6.0% +5.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -4.0% -4.2% +0.2% +10.0% ➖ noise
15 duckdb:duckdb -2.0% -4.2% +2.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.4% -4.2% +4.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -4.8% -5.7% +1.0% +10.0% ➖ noise
16 duckdb:duckdb -2.5% -5.7% +3.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.4% -5.7% +3.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -6.6% -4.4% -2.3% +10.0% ➖ noise
17 duckdb:duckdb -2.0% -4.4% +2.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.2% -4.4% +4.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -6.9% -6.4% -0.5% +10.0% ➖ noise
18 duckdb:duckdb -5.7% -6.4% +0.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.8% -6.4% +5.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.6% -3.9% +4.7% +31.8% ➖ noise
19 duckdb:duckdb +2.7% -3.9% +6.9% +20.0% ➖ noise
19 duckdb:vortex-file-compressed -5.7% -3.9% -1.8% +29.3% ➖ noise
20 datafusion:vortex-file-compressed -2.0% -5.0% +3.2% +198.7% ➖ noise
20 duckdb:duckdb -2.4% -5.0% +2.7% +74.1% ➖ noise
20 duckdb:vortex-file-compressed -0.8% -5.0% +4.4% +51.2% ➖ noise
21 datafusion:vortex-file-compressed -4.0% -7.8% +4.1% +10.0% ➖ noise
21 duckdb:duckdb -1.9% -7.8% +6.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.5% -7.8% +10.1% +10.0% 🚨 regression
22 datafusion:vortex-file-compressed -2.7% -2.9% +0.2% +14.7% ➖ noise
22 duckdb:duckdb +3.1% -2.9% +6.1% +35.5% ➖ noise
22 duckdb:vortex-file-compressed -1.7% -2.9% +1.2% +22.3% ➖ noise
23 datafusion:vortex-file-compressed +2.6% -3.9% +6.7% +44.4% ➖ noise
23 duckdb:duckdb -4.6% -3.9% -0.8% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -1.2% -3.9% +2.8% +16.9% ➖ noise
24 datafusion:vortex-file-compressed -2.6% +1.2% -3.8% +14.2% ➖ noise
24 duckdb:duckdb -0.1% +1.2% -1.4% +31.2% ➖ noise
24 duckdb:vortex-file-compressed -2.7% +1.2% -3.9% +15.9% ➖ noise
25 datafusion:vortex-file-compressed -8.6% -2.0% -6.8% +12.6% ➖ noise
25 duckdb:duckdb -0.8% -2.0% +1.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +7.6% -2.0% +9.8% +13.6% ➖ noise
26 datafusion:vortex-file-compressed -8.6% +5.0% -13.0% +12.9% ✅ faster
26 duckdb:duckdb -1.2% +5.0% -5.9% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +2.8% +5.0% -2.1% +15.0% ➖ noise
27 datafusion:vortex-file-compressed -2.8% -3.0% +0.2% +10.0% ➖ noise
27 duckdb:duckdb -1.5% -3.0% +1.5% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +2.4% -3.0% +5.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.1% -1.8% +1.7% +10.0% ➖ noise
28 duckdb:duckdb +0.8% -1.8% +2.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.9% -1.8% +0.9% +11.4% ➖ noise
29 datafusion:vortex-file-compressed +9.3% +0.6% +8.7% +12.2% ➖ noise
29 duckdb:duckdb -0.1% +0.6% -0.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +21.2% +0.6% +20.5% +46.8% ➖ noise
30 datafusion:vortex-file-compressed -5.1% -3.4% -1.7% +10.0% ➖ noise
30 duckdb:duckdb +0.0% -3.4% +3.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -2.8% -3.4% +0.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -3.2% -2.0% -1.2% +10.0% ➖ noise
31 duckdb:duckdb -1.0% -2.0% +1.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -3.1% -2.0% -1.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -7.6% -4.1% -3.6% +10.0% ➖ noise
32 duckdb:duckdb -3.3% -4.1% +0.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.8% -4.1% +3.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -5.8% -4.2% -1.6% +10.0% ➖ noise
33 duckdb:duckdb -4.4% -4.2% -0.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -11.3% -4.2% -7.4% +17.2% ➖ noise
34 datafusion:vortex-file-compressed -10.6% -2.6% -8.3% +10.0% ➖ noise
34 duckdb:duckdb -3.3% -2.6% -0.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.7% -2.6% +2.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -9.1% -5.3% -4.0% +10.0% ➖ noise
35 duckdb:duckdb +0.1% -5.3% +5.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.3% -5.3% +5.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -19.5% -4.9% -15.4% +15.0% ✅ faster
36 duckdb:duckdb -2.9% -4.9% +2.1% +11.6% ➖ noise
36 duckdb:vortex-file-compressed -0.7% -4.9% +4.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -8.9% -0.6% -8.4% +11.1% ➖ noise
37 duckdb:duckdb -1.2% -0.6% -0.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -7.2% -0.6% -6.6% +14.2% ➖ noise
38 datafusion:vortex-file-compressed -10.3% -0.7% -9.7% +18.8% ➖ noise
38 duckdb:duckdb +1.0% -0.7% +1.8% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -1.2% -0.7% -0.5% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -11.9% +5.9% -16.7% +10.3% ✅ faster
39 duckdb:duckdb -5.9% +5.9% -11.1% +21.8% ➖ noise
39 duckdb:vortex-file-compressed -4.8% +5.9% -10.1% +10.0% ✅ faster
40 datafusion:vortex-file-compressed -11.2% -3.7% -7.7% +12.2% ➖ noise
40 duckdb:duckdb -3.4% -3.7% +0.4% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +1.9% -3.7% +5.9% +10.9% ➖ noise
41 datafusion:vortex-file-compressed -14.1% -3.5% -11.0% +10.0% ✅ faster
41 duckdb:duckdb -3.3% -3.5% +0.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.2% -3.5% +3.8% +12.9% ➖ noise
42 datafusion:vortex-file-compressed -11.7% +0.9% -12.5% +14.1% ✅ faster
42 duckdb:duckdb -4.3% +0.9% -5.2% +13.2% ➖ noise
42 duckdb:vortex-file-compressed -8.4% +0.9% -9.3% +11.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.017x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 127367409 124052496 1.03
appian_q02/datafusion:vortex-file-compressed 662117077 670672430 0.99
appian_q03/datafusion:vortex-file-compressed 363426382 365326127 0.99
appian_q04/datafusion:vortex-file-compressed 28316603871 26532447068 1.07
appian_q05/datafusion:vortex-file-compressed 267209162 261315164 1.02
appian_q06/datafusion:vortex-file-compressed 428744305 418884699 1.02
appian_q07/datafusion:vortex-file-compressed 460684383 451533836 1.02
appian_q08/datafusion:vortex-file-compressed 1856411197 1858756085 1.00
datafusion / parquet (1.024x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 131044822 132337517 0.99
appian_q02/datafusion:parquet 673412706 667051648 1.01
appian_q03/datafusion:parquet 360468186 354163127 1.02
appian_q04/datafusion:parquet 28742467661 26470184966 1.09
appian_q05/datafusion:parquet 298069778 287721520 1.04
appian_q06/datafusion:parquet 440894697 435324376 1.01
appian_q07/datafusion:parquet 465287784 457353331 1.02
appian_q08/datafusion:parquet 1884326571 1835158405 1.03
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 194534471 192444538 1.01
appian_q02/duckdb:vortex-file-compressed 623282797 610737071 1.02
appian_q03/duckdb:vortex-file-compressed 262135494 258896528 1.01
appian_q04/duckdb:vortex-file-compressed 1316866784 1327039457 0.99
appian_q05/duckdb:vortex-file-compressed 294200072 291651456 1.01
appian_q06/duckdb:vortex-file-compressed 787121824 806403638 0.98
appian_q07/duckdb:vortex-file-compressed 336890280 335362190 1.00
appian_q08/duckdb:vortex-file-compressed 1273575571 1276055568 1.00
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 205564968 200795057 1.02
appian_q02/duckdb:parquet 605869473 605500923 1.00
appian_q03/duckdb:parquet 287778353 287578317 1.00
appian_q04/duckdb:parquet 1323932284 1327168209 1.00
appian_q05/duckdb:parquet 320596600 310179263 1.03
appian_q06/duckdb:parquet 778251776 795023902 0.98
appian_q07/duckdb:parquet 363623040 362671159 1.00
appian_q08/duckdb:parquet 1270905176 1274652384 1.00
duckdb / duckdb (1.005x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 173449399 171385372 1.01
appian_q02/duckdb:duckdb 549781467 547116459 1.00
appian_q03/duckdb:duckdb 387211995 380474907 1.02
appian_q04/duckdb:duckdb 1300935982 1299301576 1.00
appian_q05/duckdb:duckdb 282522625 281629058 1.00
appian_q06/duckdb:duckdb 771209236 781210894 0.99
appian_q07/duckdb:duckdb 328387197 323835023 1.01
appian_q08/duckdb:duckdb 1219234056 1220162568 1.00
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 272.98 MB → 272.72 MB (-0.1%)
  • vortex-file-compressed: 527.16 MB → 527.16 MB (0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed +2.7% +0.7% +2.0% +12.2% ➖ noise
1 duckdb:duckdb +1.2% +0.7% +0.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.1% +0.7% +0.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.3% +0.5% -1.8% +10.0% ➖ noise
2 duckdb:duckdb +0.5% +0.5% -0.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.1% +0.5% +1.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.5% +0.9% -1.4% +10.0% ➖ noise
3 duckdb:duckdb +1.8% +0.9% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% +0.9% +0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +6.7% +4.1% +2.5% +10.0% ➖ noise
4 duckdb:duckdb +0.1% +4.1% -3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% +4.1% -4.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.3% +3.5% -1.2% +14.1% ➖ noise
5 duckdb:duckdb +0.3% +3.5% -3.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% +3.5% -2.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.4% -0.4% +2.8% +10.0% ➖ noise
6 duckdb:duckdb -1.3% -0.4% -0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.4% -0.4% -2.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.0% +1.0% +1.0% +10.0% ➖ noise
7 duckdb:duckdb +1.4% +1.0% +0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.1% +1.2% -1.3% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +1.2% -1.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.2% +1.2% -1.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.3%
Engines: DataFusion No clear signal (+13.3%, environment too noisy confidence) · DuckDB No clear signal (+7.4%, environment too noisy confidence)
Vortex (geomean): 0.963x ➖
Parquet (geomean): 0.873x ➖
Shifts: Parquet (control) -12.7% · Median polish -8.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.970x ➖, 2↑ 3↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 260707089 239159556 1.09
tpch_q02/datafusion:vortex-file-compressed 480174125 511240507 0.94
tpch_q03/datafusion:vortex-file-compressed 444483982 492232015 0.90
tpch_q04/datafusion:vortex-file-compressed 233390326 261859321 0.89
tpch_q05/datafusion:vortex-file-compressed 524522484 571913911 0.92
tpch_q06/datafusion:vortex-file-compressed 🚨 463708795 356213508 1.30
tpch_q07/datafusion:vortex-file-compressed 🚨 629191054 403246686 1.56
tpch_q08/datafusion:vortex-file-compressed 911142200 798341217 1.14
tpch_q09/datafusion:vortex-file-compressed 597308370 692793373 0.86
tpch_q10/datafusion:vortex-file-compressed 811872089 819977122 0.99
tpch_q11/datafusion:vortex-file-compressed 430545556 588314714 0.73
tpch_q12/datafusion:vortex-file-compressed 🚀 560091506 826301851 0.68
tpch_q13/datafusion:vortex-file-compressed 203103951 246774663 0.82
tpch_q14/datafusion:vortex-file-compressed 346581899 421498951 0.82
tpch_q15/datafusion:vortex-file-compressed 733091860 652530597 1.12
tpch_q16/datafusion:vortex-file-compressed 364258856 292626405 1.24
tpch_q17/datafusion:vortex-file-compressed 620492730 610838834 1.02
tpch_q18/datafusion:vortex-file-compressed 586418779 477078239 1.23
tpch_q19/datafusion:vortex-file-compressed 🚨 851878900 625538337 1.36
tpch_q20/datafusion:vortex-file-compressed 561421564 505906949 1.11
tpch_q21/datafusion:vortex-file-compressed 665427485 765137469 0.87
tpch_q22/datafusion:vortex-file-compressed 🚀 150487283 339495419 0.44
datafusion / vortex-compact (0.948x ➖, 1↑ 2↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 265172850 318696504 0.83
tpch_q02/datafusion:vortex-compact 536608656 565259195 0.95
tpch_q03/datafusion:vortex-compact 🚨 809984114 485442781 1.67
tpch_q04/datafusion:vortex-compact 🚨 349602720 218530089 1.60
tpch_q05/datafusion:vortex-compact 456212468 490813295 0.93
tpch_q06/datafusion:vortex-compact 328015109 339180064 0.97
tpch_q07/datafusion:vortex-compact 476276859 603358391 0.79
tpch_q08/datafusion:vortex-compact 731466220 682471945 1.07
tpch_q09/datafusion:vortex-compact 411236112 556039830 0.74
tpch_q10/datafusion:vortex-compact 509738019 536184090 0.95
tpch_q11/datafusion:vortex-compact 365271852 315105812 1.16
tpch_q12/datafusion:vortex-compact 493188039 443825765 1.11
tpch_q13/datafusion:vortex-compact 🚀 142458457 203992644 0.70
tpch_q14/datafusion:vortex-compact 287223766 310997834 0.92
tpch_q15/datafusion:vortex-compact 483032659 614630374 0.79
tpch_q16/datafusion:vortex-compact 228771159 240231055 0.95
tpch_q17/datafusion:vortex-compact 484981386 636255024 0.76
tpch_q18/datafusion:vortex-compact 414613655 492296117 0.84
tpch_q19/datafusion:vortex-compact 689727679 657750608 1.05
tpch_q20/datafusion:vortex-compact 457182903 448123543 1.02
tpch_q21/datafusion:vortex-compact 598818005 727534982 0.82
tpch_q22/datafusion:vortex-compact 122242876 157251886 0.78
datafusion / parquet (0.847x ➖, 5↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 233425086 249256289 0.94
tpch_q02/datafusion:parquet 491850019 438329021 1.12
tpch_q03/datafusion:parquet 403277756 357185115 1.13
tpch_q04/datafusion:parquet 178111524 228602120 0.78
tpch_q05/datafusion:parquet 664333038 547417458 1.21
tpch_q06/datafusion:parquet 232547676 225200973 1.03
tpch_q07/datafusion:parquet 516893256 654840103 0.79
tpch_q08/datafusion:parquet 580558322 689627845 0.84
tpch_q09/datafusion:parquet 499308467 561043345 0.89
tpch_q10/datafusion:parquet 563013801 577050140 0.98
tpch_q11/datafusion:parquet 371015423 314783240 1.18
tpch_q12/datafusion:parquet 272261802 308902836 0.88
tpch_q13/datafusion:parquet 495816039 590228189 0.84
tpch_q14/datafusion:parquet 262312773 351370412 0.75
tpch_q15/datafusion:parquet 454010288 476288286 0.95
tpch_q16/datafusion:parquet 190852174 218946467 0.87
tpch_q17/datafusion:parquet 598033361 727040378 0.82
tpch_q18/datafusion:parquet 🚀 545318492 1092368488 0.50
tpch_q19/datafusion:parquet 🚀 371676826 631361972 0.59
tpch_q20/datafusion:parquet 🚀 402961722 594447459 0.68
tpch_q21/datafusion:parquet 🚀 569444334 845110110 0.67
tpch_q22/datafusion:parquet 🚀 120891301 188114144 0.64
duckdb / vortex-file-compressed (0.952x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 327872185 328921330 1.00
tpch_q02/duckdb:vortex-file-compressed 1004541818 987884414 1.02
tpch_q03/duckdb:vortex-file-compressed 731912984 748256313 0.98
tpch_q04/duckdb:vortex-file-compressed 478823050 519149135 0.92
tpch_q05/duckdb:vortex-file-compressed 955107613 964476063 0.99
tpch_q06/duckdb:vortex-file-compressed 325842444 446600559 0.73
tpch_q07/duckdb:vortex-file-compressed 924503023 1031967760 0.90
tpch_q08/duckdb:vortex-file-compressed 1056385415 1151143796 0.92
tpch_q09/duckdb:vortex-file-compressed 1023933923 1205731312 0.85
tpch_q10/duckdb:vortex-file-compressed 841901313 767927611 1.10
tpch_q11/duckdb:vortex-file-compressed 539707745 559197427 0.97
tpch_q12/duckdb:vortex-file-compressed 763480076 793930529 0.96
tpch_q13/duckdb:vortex-file-compressed 490165482 485791192 1.01
tpch_q14/duckdb:vortex-file-compressed 449411985 425592510 1.06
tpch_q15/duckdb:vortex-file-compressed 348106764 316635786 1.10
tpch_q16/duckdb:vortex-file-compressed 352883321 346208982 1.02
tpch_q17/duckdb:vortex-file-compressed 766384357 863289589 0.89
tpch_q18/duckdb:vortex-file-compressed 581145393 628160941 0.93
tpch_q19/duckdb:vortex-file-compressed 469652688 494642024 0.95
tpch_q20/duckdb:vortex-file-compressed 788207212 898449553 0.88
tpch_q21/duckdb:vortex-file-compressed 1087448105 1198041920 0.91
tpch_q22/duckdb:vortex-file-compressed 286902241 296896867 0.97
duckdb / vortex-compact (0.982x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 292638741 358876267 0.82
tpch_q02/duckdb:vortex-compact 937441685 1073928543 0.87
tpch_q03/duckdb:vortex-compact 707841524 671251102 1.05
tpch_q04/duckdb:vortex-compact 364905293 458911951 0.80
tpch_q05/duckdb:vortex-compact 934305486 854182710 1.09
tpch_q06/duckdb:vortex-compact 415725288 369859752 1.12
tpch_q07/duckdb:vortex-compact 907994797 1003641120 0.90
tpch_q08/duckdb:vortex-compact 1058228318 971602851 1.09
tpch_q09/duckdb:vortex-compact 1103226652 1010776951 1.09
tpch_q10/duckdb:vortex-compact 784904002 760172430 1.03
tpch_q11/duckdb:vortex-compact 551174725 556215907 0.99
tpch_q12/duckdb:vortex-compact 741065539 672949541 1.10
tpch_q13/duckdb:vortex-compact 380576917 452230427 0.84
tpch_q14/duckdb:vortex-compact 439777750 403654307 1.09
tpch_q15/duckdb:vortex-compact 329627217 321014120 1.03
tpch_q16/duckdb:vortex-compact 349253335 352078803 0.99
tpch_q17/duckdb:vortex-compact 755822571 733075623 1.03
tpch_q18/duckdb:vortex-compact 530002687 559098855 0.95
tpch_q19/duckdb:vortex-compact 478020937 571483845 0.84
tpch_q20/duckdb:vortex-compact 741156107 811454963 0.91
tpch_q21/duckdb:vortex-compact 1094602757 1150879094 0.95
tpch_q22/duckdb:vortex-compact 318240262 278698100 1.14
duckdb / parquet (0.900x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 489037872 468933457 1.04
tpch_q02/duckdb:parquet 1111478905 1144198606 0.97
tpch_q03/duckdb:parquet 1028545611 1451239453 0.71
tpch_q04/duckdb:parquet 627134521 627728440 1.00
tpch_q05/duckdb:parquet 1373374456 1425944958 0.96
tpch_q06/duckdb:parquet 455778350 592958464 0.77
tpch_q07/duckdb:parquet 1194920826 1358747241 0.88
tpch_q08/duckdb:parquet 1492803588 1680917640 0.89
tpch_q09/duckdb:parquet 1503086681 1464937937 1.03
tpch_q10/duckdb:parquet 1487758557 1551342138 0.96
tpch_q11/duckdb:parquet 720664834 798828467 0.90
tpch_q12/duckdb:parquet 802922485 867316077 0.93
tpch_q13/duckdb:parquet 1101594966 1037648348 1.06
tpch_q14/duckdb:parquet 758348614 909426144 0.83
tpch_q15/duckdb:parquet 607108548 749755126 0.81
tpch_q16/duckdb:parquet 724575061 737709090 0.98
tpch_q17/duckdb:parquet 793819809 946802725 0.84
tpch_q18/duckdb:parquet 867977615 1116709981 0.78
tpch_q19/duckdb:parquet 757266860 851630323 0.89
tpch_q20/duckdb:parquet 1252149165 1392967749 0.90
tpch_q21/duckdb:parquet 1216435036 1405260203 0.87
tpch_q22/duckdb:parquet 558168648 614151343 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -16.8% -1.2% -15.8% +70.4% ➖ noise
1 datafusion:vortex-file-compressed +9.0% -1.2% +10.3% +91.1% ➖ noise
1 duckdb:vortex-compact -18.5% -1.2% -17.5% +51.8% ➖ noise
1 duckdb:vortex-file-compressed -0.3% -1.2% +0.9% +52.2% ➖ noise
2 datafusion:vortex-compact -5.1% +4.4% -9.1% +40.4% ➖ noise
2 datafusion:vortex-file-compressed -6.1% +4.4% -10.0% +40.4% ➖ noise
2 duckdb:vortex-compact -12.7% +4.4% -16.4% +40.4% ➖ noise
2 duckdb:vortex-file-compressed +1.7% +4.4% -2.6% +40.4% ➖ noise
3 datafusion:vortex-compact +66.9% -10.5% +86.5% +60.4% 🚨 regression
3 datafusion:vortex-file-compressed -9.7% -10.5% +0.9% +52.4% ➖ noise
3 duckdb:vortex-compact +5.5% -10.5% +17.9% +40.4% ➖ noise
3 duckdb:vortex-file-compressed -2.2% -10.5% +9.3% +40.4% ➖ noise
4 datafusion:vortex-compact +60.0% -11.8% +81.3% +49.1% 🚨 regression
4 datafusion:vortex-file-compressed -10.9% -11.8% +1.0% +40.4% ➖ noise
4 duckdb:vortex-compact -20.5% -11.8% -9.9% +40.4% ➖ noise
4 duckdb:vortex-file-compressed -7.8% -11.8% +4.5% +48.6% ➖ noise
5 datafusion:vortex-compact -7.0% +8.1% -14.0% +40.4% ➖ noise
5 datafusion:vortex-file-compressed -8.3% +8.1% -15.2% +40.4% ➖ noise
5 duckdb:vortex-compact +9.4% +8.1% +1.2% +40.4% ➖ noise
5 duckdb:vortex-file-compressed -1.0% +8.1% -8.4% +40.4% ➖ noise
6 datafusion:vortex-compact -3.3% -10.9% +8.5% +40.4% ➖ noise
6 datafusion:vortex-file-compressed +30.2% -10.9% +46.1% +40.4% 🚨 regression
6 duckdb:vortex-compact +12.4% -10.9% +26.2% +40.4% ➖ noise
6 duckdb:vortex-file-compressed -27.0% -10.9% -18.1% +40.4% ➖ noise
7 datafusion:vortex-compact -21.1% -16.7% -5.3% +40.4% ➖ noise
7 datafusion:vortex-file-compressed +56.0% -16.7% +87.3% +40.4% 🚨 regression
7 duckdb:vortex-compact -9.5% -16.7% +8.6% +40.4% ➖ noise
7 duckdb:vortex-file-compressed -10.4% -16.7% +7.5% +40.4% ➖ noise
8 datafusion:vortex-compact +7.2% -13.5% +24.0% +40.4% ➖ noise
8 datafusion:vortex-file-compressed +14.1% -13.5% +32.0% +40.4% ➖ noise
8 duckdb:vortex-compact +8.9% -13.5% +26.0% +40.4% ➖ noise
8 duckdb:vortex-file-compressed -8.2% -13.5% +6.1% +40.4% ➖ noise
9 datafusion:vortex-compact -26.0% -4.4% -22.6% +40.4% ➖ noise
9 datafusion:vortex-file-compressed -13.8% -4.4% -9.8% +40.4% ➖ noise
9 duckdb:vortex-compact +9.1% -4.4% +14.2% +40.4% ➖ noise
9 duckdb:vortex-file-compressed -15.1% -4.4% -11.1% +40.4% ➖ noise
10 datafusion:vortex-compact -4.9% -3.3% -1.7% +40.4% ➖ noise
10 datafusion:vortex-file-compressed -1.0% -3.3% +2.4% +40.4% ➖ noise
10 duckdb:vortex-compact +3.3% -3.3% +6.7% +40.4% ➖ noise
10 duckdb:vortex-file-compressed +9.6% -3.3% +13.3% +40.4% ➖ noise
11 datafusion:vortex-compact +15.9% +3.1% +12.4% +40.4% ➖ noise
11 datafusion:vortex-file-compressed -26.8% +3.1% -29.0% +40.4% ✅ faster
11 duckdb:vortex-compact -0.9% +3.1% -3.9% +40.4% ➖ noise
11 duckdb:vortex-file-compressed -3.5% +3.1% -6.4% +40.4% ➖ noise
12 datafusion:vortex-compact +11.1% -9.7% +23.0% +40.4% ➖ noise
12 datafusion:vortex-file-compressed -32.2% -9.7% -25.0% +40.4% ➖ noise
12 duckdb:vortex-compact +10.1% -9.7% +21.9% +40.4% ➖ noise
12 duckdb:vortex-file-compressed -3.8% -9.7% +6.5% +40.4% ➖ noise
13 datafusion:vortex-compact -30.2% -5.6% -26.1% +42.3% ➖ noise
13 datafusion:vortex-file-compressed -17.7% -5.6% -12.8% +40.4% ➖ noise
13 duckdb:vortex-compact -15.8% -5.6% -10.9% +40.4% ➖ noise
13 duckdb:vortex-file-compressed +0.9% -5.6% +6.8% +40.4% ➖ noise
14 datafusion:vortex-compact -7.6% -21.1% +17.1% +51.5% ➖ noise
14 datafusion:vortex-file-compressed -17.8% -21.1% +4.2% +40.4% ➖ noise
14 duckdb:vortex-compact +8.9% -21.1% +38.1% +40.4% ➖ noise
14 duckdb:vortex-file-compressed +5.6% -21.1% +33.8% +40.4% ➖ noise
15 datafusion:vortex-compact -21.4% -12.1% -10.5% +40.4% ➖ noise
15 datafusion:vortex-file-compressed +12.3% -12.1% +27.9% +40.4% ➖ noise
15 duckdb:vortex-compact +2.7% -12.1% +16.9% +40.4% ➖ noise
15 duckdb:vortex-file-compressed +9.9% -12.1% +25.1% +40.4% ➖ noise
16 datafusion:vortex-compact -4.8% -7.5% +2.9% +40.4% ➖ noise
16 datafusion:vortex-file-compressed +24.5% -7.5% +34.5% +40.4% ➖ noise
16 duckdb:vortex-compact -0.8% -7.5% +7.2% +40.4% ➖ noise
16 duckdb:vortex-file-compressed +1.9% -7.5% +10.2% +40.4% ➖ noise
17 datafusion:vortex-compact -23.8% -17.0% -8.2% +40.4% ➖ noise
17 datafusion:vortex-file-compressed +1.6% -17.0% +22.3% +41.4% ➖ noise
17 duckdb:vortex-compact +3.1% -17.0% +24.2% +40.4% ➖ noise
17 duckdb:vortex-file-compressed -11.2% -17.0% +6.9% +40.4% ➖ noise
18 datafusion:vortex-compact -15.8% -37.7% +35.2% +40.4% ➖ noise
18 datafusion:vortex-file-compressed +22.9% -37.7% +97.3% +40.4% 🚨 regression
18 duckdb:vortex-compact -5.2% -37.7% +52.2% +40.4% 🚨 regression
18 duckdb:vortex-file-compressed -7.5% -37.7% +48.5% +40.4% 🚨 regression
19 datafusion:vortex-compact +4.9% -27.6% +44.9% +40.4% 🚨 regression
19 datafusion:vortex-file-compressed +36.2% -27.6% +88.2% +40.4% 🚨 regression
19 duckdb:vortex-compact -16.4% -27.6% +15.6% +40.4% ➖ noise
19 duckdb:vortex-file-compressed -5.1% -27.6% +31.2% +40.4% ➖ noise
20 datafusion:vortex-compact +2.0% -21.9% +30.7% +40.4% ➖ noise
20 datafusion:vortex-file-compressed +11.0% -21.9% +42.2% +40.4% 🚨 regression
20 duckdb:vortex-compact -8.7% -21.9% +17.0% +40.4% ➖ noise
20 duckdb:vortex-file-compressed -12.3% -21.9% +12.4% +40.4% ➖ noise
21 datafusion:vortex-compact -17.7% -23.6% +7.8% +40.4% ➖ noise
21 datafusion:vortex-file-compressed -13.0% -23.6% +13.9% +40.4% ➖ noise
21 duckdb:vortex-compact -4.9% -23.6% +24.5% +40.4% ➖ noise
21 duckdb:vortex-file-compressed -9.2% -23.6% +18.9% +40.4% ➖ noise
22 datafusion:vortex-compact -22.3% -23.6% +1.7% +40.4% ➖ noise
22 datafusion:vortex-file-compressed -55.7% -23.6% -42.0% +43.6% ✅ faster
22 duckdb:vortex-compact +14.2% -23.6% +49.4% +40.4% 🚨 regression
22 duckdb:vortex-file-compressed -3.4% -23.6% +26.4% +40.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Compression

Vortex (geomean): 0.997x ➖
Parquet (geomean): 0.998x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.998x ➖, 2↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
compress time/Arade 1139328220 1151956406 0.99
compress time/Bimbo 5771158907 5856914621 0.99
compress time/CMSprovider 2809936329 2818613997 1.00
compress time/Euro2016 440392724 437732515 1.01
compress time/Food 373438803 368991450 1.01
compress time/HashTags 789287408 796849457 0.99
compress time/TPC-H l_comment canonical 1232875043 1253219910 0.98
compress time/TPC-H l_comment chunked 1231251901 1253860555 0.98
compress time/taxi 694683856 703988182 0.99
compress time/wide table cols=100 chunks=1 rows=1000 11681970 11485133 1.02
compress time/wide table cols=100 chunks=50 rows=1000 12166748 12860266 0.95
compress time/wide table cols=1000 chunks=1 rows=1000 123969592 128465628 0.97
compress time/wide table cols=1000 chunks=50 rows=1000 128000209 125710239 1.02
compress time/wide table cols=10000 chunks=1 rows=1000 1497139707 1474426422 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1503666927 1468021502 1.02
decompress time/Arade 28726071 26335608 1.09
decompress time/Bimbo 🚀 80039970 92007044 0.87
decompress time/CMSprovider 81731135 76520866 1.07
decompress time/Euro2016 19826013 19587062 1.01
decompress time/Food 8117351 8517531 0.95
decompress time/HashTags 88375418 87650548 1.01
decompress time/TPC-H l_comment canonical 40039752 40144277 1.00
decompress time/TPC-H l_comment chunked 41309049 39604195 1.04
decompress time/taxi 14462022 16068077 0.90
decompress time/wide table cols=100 chunks=1 rows=1000 2764951 2558147 1.08
decompress time/wide table cols=100 chunks=50 rows=1000 2652769 2709274 0.98
decompress time/wide table cols=1000 chunks=1 rows=1000 24175539 24063103 1.00
decompress time/wide table cols=1000 chunks=50 rows=1000 24864235 24705269 1.01
decompress time/wide table cols=10000 chunks=1 rows=1000 258799814 269611171 0.96
decompress time/wide table cols=10000 chunks=50 rows=1000 254422730 255839582 0.99
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2623165294 2641569855 0.99
parquet_rs-zstd compress time/Bimbo 12846631019 12793154531 1.00
parquet_rs-zstd compress time/CMSprovider 6947225096 7019047386 0.99
parquet_rs-zstd compress time/Euro2016 1327068585 1319581135 1.01
parquet_rs-zstd compress time/Food 804985831 809188339 0.99
parquet_rs-zstd compress time/HashTags 2244354654 2234283396 1.00
parquet_rs-zstd compress time/TPC-H l_comment canonical 3236355723 3250875274 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3245211341 3223559528 1.01
parquet_rs-zstd compress time/taxi 1196032400 1207675514 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6148794 6218301 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6296292 6489886 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 75780658 75203246 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74966219 75373573 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 782606141 784353103 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 818250236 801585325 1.02
parquet_rs-zstd decompress time/Arade 623721767 620068912 1.01
parquet_rs-zstd decompress time/Bimbo 1714242632 1694829721 1.01
parquet_rs-zstd decompress time/CMSprovider 1736938608 1718331199 1.01
parquet_rs-zstd decompress time/Euro2016 381328591 378241221 1.01
parquet_rs-zstd decompress time/Food 200425827 196648366 1.02
parquet_rs-zstd decompress time/HashTags 660014757 675803602 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 600148927 593287152 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 597648320 602599996 0.99
parquet_rs-zstd decompress time/taxi 245010332 245955065 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2804940 2811785 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2896811 2770550 1.05
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33298500 32314351 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33175809 33482314 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 347272665 346024671 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 350638179 349566016 1.00
vortex-file-compressed size/Arade 145363828 145363828 1.00
vortex-file-compressed size/Bimbo 468763364 468763364 1.00
vortex-file-compressed size/CMSprovider 417907844 417907844 1.00
vortex-file-compressed size/Euro2016 163394356 163394772 1.00
vortex-file-compressed size/Food 41926968 41926968 1.00
vortex-file-compressed size/HashTags 195647860 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087392 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087392 179087392 1.00
vortex-file-compressed size/taxi 52363980 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.01
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 1.02
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.08
vortex:parquet-zstd ratio decompress time/Bimbo 🚀 0 0 0.86
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.06
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 0.94
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.90
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.1%
Engines: DataFusion No clear signal (+8.4%, environment too noisy confidence) · DuckDB No clear signal (+5.9%, environment too noisy confidence)
Vortex (geomean): 0.964x ➖
Parquet (geomean): 0.900x ➖
Shifts: Parquet (control) -10.0% · Median polish -5.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 833134758 706178950 1.18
tpch_q02/datafusion:vortex-file-compressed 824996483 1032281280 0.80
tpch_q03/datafusion:vortex-file-compressed 903384565 963986475 0.94
tpch_q04/datafusion:vortex-file-compressed 651922314 644707156 1.01
tpch_q05/datafusion:vortex-file-compressed 967731295 1044961729 0.93
tpch_q06/datafusion:vortex-file-compressed 588928482 583731764 1.01
tpch_q07/datafusion:vortex-file-compressed 1181779784 1126073057 1.05
tpch_q08/datafusion:vortex-file-compressed 1555981839 1553637956 1.00
tpch_q09/datafusion:vortex-file-compressed 1548094547 1503165680 1.03
tpch_q10/datafusion:vortex-file-compressed 1137180904 1055798826 1.08
tpch_q11/datafusion:vortex-file-compressed 595298126 619358008 0.96
tpch_q12/datafusion:vortex-file-compressed 1087100449 853513912 1.27
tpch_q13/datafusion:vortex-file-compressed 542525549 439256954 1.24
tpch_q14/datafusion:vortex-file-compressed 697360294 552381585 1.26
tpch_q15/datafusion:vortex-file-compressed 1256700702 1221146289 1.03
tpch_q16/datafusion:vortex-file-compressed 556410526 755411892 0.74
tpch_q17/datafusion:vortex-file-compressed 1228222191 1237566463 0.99
tpch_q18/datafusion:vortex-file-compressed 1302268152 1308352344 1.00
tpch_q19/datafusion:vortex-file-compressed 833153102 1010120934 0.82
tpch_q20/datafusion:vortex-file-compressed 986714548 1150160445 0.86
tpch_q21/datafusion:vortex-file-compressed 1769930334 2229802428 0.79
tpch_q22/datafusion:vortex-file-compressed 506148720 531414412 0.95
datafusion / vortex-compact (0.917x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 785467399 706299092 1.11
tpch_q02/datafusion:vortex-compact 924998679 1163425399 0.80
tpch_q03/datafusion:vortex-compact 823314401 1101423803 0.75
tpch_q04/datafusion:vortex-compact 530658277 674785560 0.79
tpch_q05/datafusion:vortex-compact 924273663 1179000318 0.78
tpch_q06/datafusion:vortex-compact 612571856 594361217 1.03
tpch_q07/datafusion:vortex-compact 1006340653 1170581606 0.86
tpch_q08/datafusion:vortex-compact 1197934678 1213460021 0.99
tpch_q09/datafusion:vortex-compact 1267614833 1331426168 0.95
tpch_q10/datafusion:vortex-compact 880091595 864893930 1.02
tpch_q11/datafusion:vortex-compact 424084327 412038452 1.03
tpch_q12/datafusion:vortex-compact 837354166 1134946746 0.74
tpch_q13/datafusion:vortex-compact 440017317 456928518 0.96
tpch_q14/datafusion:vortex-compact 622891794 623493045 1.00
tpch_q15/datafusion:vortex-compact 988134728 1175326577 0.84
tpch_q16/datafusion:vortex-compact 386344123 457801305 0.84
tpch_q17/datafusion:vortex-compact 1209196091 1321501627 0.92
tpch_q18/datafusion:vortex-compact 1224940128 1161797152 1.05
tpch_q19/datafusion:vortex-compact 828940275 864791065 0.96
tpch_q20/datafusion:vortex-compact 973273510 944124564 1.03
tpch_q21/datafusion:vortex-compact 1503200561 1671455445 0.90
tpch_q22/datafusion:vortex-compact 528070481 547570204 0.96
datafusion / parquet (0.877x ➖, 2↑ 1↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 887412912 928201060 0.96
tpch_q02/datafusion:parquet 1085912625 1188878924 0.91
tpch_q03/datafusion:parquet 🚀 1023431653 1539123780 0.66
tpch_q04/datafusion:parquet 525867292 626694728 0.84
tpch_q05/datafusion:parquet 1255992743 1279378875 0.98
tpch_q06/datafusion:parquet 531065912 573415435 0.93
tpch_q07/datafusion:parquet 1403884864 1995038956 0.70
tpch_q08/datafusion:parquet 1602973186 2260236977 0.71
tpch_q09/datafusion:parquet 2249562700 2370744231 0.95
tpch_q10/datafusion:parquet 2859891771 2499370596 1.14
tpch_q11/datafusion:parquet 🚨 1068723389 542783478 1.97
tpch_q12/datafusion:parquet 790633275 970705453 0.81
tpch_q13/datafusion:parquet 955343638 1257789848 0.76
tpch_q14/datafusion:parquet 🚀 862277437 1348715322 0.64
tpch_q15/datafusion:parquet 1720461858 1731948049 0.99
tpch_q16/datafusion:parquet 481321173 569321583 0.85
tpch_q17/datafusion:parquet 1628873533 1689926272 0.96
tpch_q18/datafusion:parquet 1681386803 2218551376 0.76
tpch_q19/datafusion:parquet 949307496 1165703907 0.81
tpch_q20/datafusion:parquet 1501421937 1913240410 0.78
tpch_q21/datafusion:parquet 2088847296 1969209305 1.06
tpch_q22/datafusion:parquet 774799723 1078017319 0.72
duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 664366850 671765304 0.99
tpch_q02/duckdb:vortex-file-compressed 1209337751 1258585749 0.96
tpch_q03/duckdb:vortex-file-compressed 1014513238 1119795398 0.91
tpch_q04/duckdb:vortex-file-compressed 833763876 872174064 0.96
tpch_q05/duckdb:vortex-file-compressed 1215649675 1168216859 1.04
tpch_q06/duckdb:vortex-file-compressed 641246094 538846764 1.19
tpch_q07/duckdb:vortex-file-compressed 1329903307 1371021024 0.97
tpch_q08/duckdb:vortex-file-compressed 1624408656 1697210718 0.96
tpch_q09/duckdb:vortex-file-compressed 1871909732 1776626400 1.05
tpch_q10/duckdb:vortex-file-compressed 1155973007 1236071645 0.94
tpch_q11/duckdb:vortex-file-compressed 645957615 731925855 0.88
tpch_q12/duckdb:vortex-file-compressed 1392983296 1341329661 1.04
tpch_q13/duckdb:vortex-file-compressed 916179333 1010296963 0.91
tpch_q14/duckdb:vortex-file-compressed 699082134 698211914 1.00
tpch_q15/duckdb:vortex-file-compressed 561618388 584705268 0.96
tpch_q16/duckdb:vortex-file-compressed 523753353 568421116 0.92
tpch_q17/duckdb:vortex-file-compressed 1010145788 952782408 1.06
tpch_q18/duckdb:vortex-file-compressed 1019785281 1047437053 0.97
tpch_q19/duckdb:vortex-file-compressed 836044899 849631838 0.98
tpch_q20/duckdb:vortex-file-compressed 1344322546 1351883396 0.99
tpch_q21/duckdb:vortex-file-compressed 2067457101 2288881586 0.90
tpch_q22/duckdb:vortex-file-compressed 435248777 530577810 0.82
duckdb / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 641539554 598423370 1.07
tpch_q02/duckdb:vortex-compact 1117705674 1189896352 0.94
tpch_q03/duckdb:vortex-compact 927302184 879442466 1.05
tpch_q04/duckdb:vortex-compact 623435180 638776750 0.98
tpch_q05/duckdb:vortex-compact 1214848795 1272968856 0.95
tpch_q06/duckdb:vortex-compact 626436508 594687151 1.05
tpch_q07/duckdb:vortex-compact 1163531476 1205113277 0.97
tpch_q08/duckdb:vortex-compact 1510656683 1358575396 1.11
tpch_q09/duckdb:vortex-compact 1723679415 1666363109 1.03
tpch_q10/duckdb:vortex-compact 1094441108 1212888804 0.90
tpch_q11/duckdb:vortex-compact 696978232 686153425 1.02
tpch_q12/duckdb:vortex-compact 1105833316 1030327075 1.07
tpch_q13/duckdb:vortex-compact 823684469 917405849 0.90
tpch_q14/duckdb:vortex-compact 696871540 691019946 1.01
tpch_q15/duckdb:vortex-compact 551327821 600609183 0.92
tpch_q16/duckdb:vortex-compact 425241557 462417598 0.92
tpch_q17/duckdb:vortex-compact 892249449 967361009 0.92
tpch_q18/duckdb:vortex-compact 836127445 903074543 0.93
tpch_q19/duckdb:vortex-compact 770852359 729814179 1.06
tpch_q20/duckdb:vortex-compact 1272091258 1247984933 1.02
tpch_q21/duckdb:vortex-compact 1749459559 1804254775 0.97
tpch_q22/duckdb:vortex-compact 407138469 446020912 0.91
duckdb / parquet (0.923x ➖, 0↑ 0↓)
name PR 70c91be (ns) base 30103b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 914416148 938358803 0.97
tpch_q02/duckdb:parquet 1399443210 1625118292 0.86
tpch_q03/duckdb:parquet 1724017906 1956191934 0.88
tpch_q04/duckdb:parquet 1017587538 1225567132 0.83
tpch_q05/duckdb:parquet 1939652935 2166759355 0.90
tpch_q06/duckdb:parquet 923827531 850060036 1.09
tpch_q07/duckdb:parquet 1896594144 2122911387 0.89
tpch_q08/duckdb:parquet 2444971867 2691674895 0.91
tpch_q09/duckdb:parquet 2523759724 2729636507 0.92
tpch_q10/duckdb:parquet 3206475268 3317904330 0.97
tpch_q11/duckdb:parquet 944904017 858352620 1.10
tpch_q12/duckdb:parquet 1185894934 1421970787 0.83
tpch_q13/duckdb:parquet 1297678425 1559734471 0.83
tpch_q14/duckdb:parquet 1345447215 1575290050 0.85
tpch_q15/duckdb:parquet 880900401 1091068357 0.81
tpch_q16/duckdb:parquet 889970013 1003311138 0.89
tpch_q17/duckdb:parquet 1228302275 1363559957 0.90
tpch_q18/duckdb:parquet 1565455742 1598577950 0.98
tpch_q19/duckdb:parquet 1528302438 1586189530 0.96
tpch_q20/duckdb:parquet 2126754844 2026954447 1.05
tpch_q21/duckdb:parquet 1903400004 1950308492 0.98
tpch_q22/duckdb:parquet 1099242042 1121874459 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +11.2% -3.5% +15.2% +45.0% ➖ noise
1 datafusion:vortex-file-compressed +18.0% -3.5% +22.2% +52.2% ➖ noise
1 duckdb:vortex-compact +7.2% -3.5% +11.1% +44.9% ➖ noise
1 duckdb:vortex-file-compressed -1.1% -3.5% +2.5% +44.9% ➖ noise
2 datafusion:vortex-compact -20.5% -11.3% -10.4% +44.9% ➖ noise
2 datafusion:vortex-file-compressed -20.1% -11.3% -9.9% +44.9% ➖ noise
2 duckdb:vortex-compact -6.1% -11.3% +5.9% +44.9% ➖ noise
2 duckdb:vortex-file-compressed -3.9% -11.3% +8.3% +44.9% ➖ noise
3 datafusion:vortex-compact -25.2% -23.4% -2.4% +52.3% ➖ noise
3 datafusion:vortex-file-compressed -6.3% -23.4% +22.4% +49.9% ➖ noise
3 duckdb:vortex-compact +5.4% -23.4% +37.7% +45.0% ➖ noise
3 duckdb:vortex-file-compressed -9.4% -23.4% +18.3% +44.9% ➖ noise
4 datafusion:vortex-compact -21.4% -16.5% -5.8% +44.9% ➖ noise
4 datafusion:vortex-file-compressed +1.1% -16.5% +21.1% +44.9% ➖ noise
4 duckdb:vortex-compact -2.4% -16.5% +16.9% +44.9% ➖ noise
4 duckdb:vortex-file-compressed -4.4% -16.5% +14.5% +44.9% ➖ noise
5 datafusion:vortex-compact -21.6% -6.3% -16.4% +44.9% ➖ noise
5 datafusion:vortex-file-compressed -7.4% -6.3% -1.2% +44.9% ➖ noise
5 duckdb:vortex-compact -4.6% -6.3% +1.8% +44.9% ➖ noise
5 duckdb:vortex-file-compressed +4.1% -6.3% +11.0% +44.9% ➖ noise
6 datafusion:vortex-compact +3.1% +0.3% +2.7% +44.9% ➖ noise
6 datafusion:vortex-file-compressed +0.9% +0.3% +0.6% +44.9% ➖ noise
6 duckdb:vortex-compact +5.3% +0.3% +5.0% +44.9% ➖ noise
6 duckdb:vortex-file-compressed +19.0% +0.3% +18.6% +44.9% ➖ noise
7 datafusion:vortex-compact -14.0% -20.7% +8.4% +44.9% ➖ noise
7 datafusion:vortex-file-compressed +4.9% -20.7% +32.4% +44.9% ➖ noise
7 duckdb:vortex-compact -3.5% -20.7% +21.8% +44.9% ➖ noise
7 duckdb:vortex-file-compressed -3.0% -20.7% +22.3% +44.9% ➖ noise
8 datafusion:vortex-compact -1.3% -19.7% +23.0% +44.9% ➖ noise
8 datafusion:vortex-file-compressed +0.2% -19.7% +24.8% +44.9% ➖ noise
8 duckdb:vortex-compact +11.2% -19.7% +38.5% +44.9% ➖ noise
8 duckdb:vortex-file-compressed -4.3% -19.7% +19.2% +44.9% ➖ noise
9 datafusion:vortex-compact -4.8% -6.3% +1.6% +44.9% ➖ noise
9 datafusion:vortex-file-compressed +3.0% -6.3% +10.0% +44.9% ➖ noise
9 duckdb:vortex-compact +3.4% -6.3% +10.4% +44.9% ➖ noise
9 duckdb:vortex-file-compressed +5.4% -6.3% +12.5% +44.9% ➖ noise
10 datafusion:vortex-compact +1.8% +5.2% -3.2% +44.9% ➖ noise
10 datafusion:vortex-file-compressed +7.7% +5.2% +2.4% +44.9% ➖ noise
10 duckdb:vortex-compact -9.8% +5.2% -14.2% +44.9% ➖ noise
10 duckdb:vortex-file-compressed -6.5% +5.2% -11.1% +44.9% ➖ noise
11 datafusion:vortex-compact +2.9% +47.2% -30.1% +44.9% ➖ noise
11 datafusion:vortex-file-compressed -3.9% +47.2% -34.7% +44.9% ✅ faster
11 duckdb:vortex-compact +1.6% +47.2% -31.0% +44.9% ✅ faster
11 duckdb:vortex-file-compressed -11.7% +47.2% -40.1% +44.9% ✅ faster
12 datafusion:vortex-compact -26.2% -17.6% -10.5% +44.9% ➖ noise
12 datafusion:vortex-file-compressed +27.4% -17.6% +54.5% +44.9% 🚨 regression
12 duckdb:vortex-compact +7.3% -17.6% +30.2% +44.9% ➖ noise
12 duckdb:vortex-file-compressed +3.9% -17.6% +26.0% +44.9% ➖ noise
13 datafusion:vortex-compact -3.7% -20.5% +21.1% +44.9% ➖ noise
13 datafusion:vortex-file-compressed +23.5% -20.5% +55.4% +44.9% 🚨 regression
13 duckdb:vortex-compact -10.2% -20.5% +12.9% +44.9% ➖ noise
13 duckdb:vortex-file-compressed -9.3% -20.5% +14.1% +44.9% ➖ noise
14 datafusion:vortex-compact -0.1% -26.1% +35.2% +44.9% ➖ noise
14 datafusion:vortex-file-compressed +26.2% -26.1% +70.8% +44.9% 🚨 regression
14 duckdb:vortex-compact +0.8% -26.1% +36.5% +44.9% ➖ noise
14 duckdb:vortex-file-compressed +0.1% -26.1% +35.5% +44.9% ➖ noise
15 datafusion:vortex-compact -15.9% -10.4% -6.1% +44.9% ➖ noise
15 datafusion:vortex-file-compressed +2.9% -10.4% +14.9% +44.9% ➖ noise
15 duckdb:vortex-compact -8.2% -10.4% +2.5% +44.9% ➖ noise
15 duckdb:vortex-file-compressed -3.9% -10.4% +7.3% +44.9% ➖ noise
16 datafusion:vortex-compact -15.6% -13.4% -2.5% +44.9% ➖ noise
16 datafusion:vortex-file-compressed -26.3% -13.4% -14.9% +44.9% ➖ noise
16 duckdb:vortex-compact -8.0% -13.4% +6.2% +44.9% ➖ noise
16 duckdb:vortex-file-compressed -7.9% -13.4% +6.4% +44.9% ➖ noise
17 datafusion:vortex-compact -8.5% -6.8% -1.8% +44.9% ➖ noise
17 datafusion:vortex-file-compressed -0.8% -6.8% +6.5% +44.9% ➖ noise
17 duckdb:vortex-compact -7.8% -6.8% -1.0% +44.9% ➖ noise
17 duckdb:vortex-file-compressed +6.0% -6.8% +13.8% +44.9% ➖ noise
18 datafusion:vortex-compact +5.4% -13.9% +22.4% +44.9% ➖ noise
18 datafusion:vortex-file-compressed -0.5% -13.9% +15.5% +44.9% ➖ noise
18 duckdb:vortex-compact -7.4% -13.9% +7.5% +44.9% ➖ noise
18 duckdb:vortex-file-compressed -2.6% -13.9% +13.0% +44.9% ➖ noise
19 datafusion:vortex-compact -4.1% -11.4% +8.2% +44.9% ➖ noise
19 datafusion:vortex-file-compressed -17.5% -11.4% -6.9% +44.9% ➖ noise
19 duckdb:vortex-compact +5.6% -11.4% +19.2% +44.9% ➖ noise
19 duckdb:vortex-file-compressed -1.6% -11.4% +11.1% +44.9% ➖ noise
20 datafusion:vortex-compact +3.1% -9.3% +13.6% +44.9% ➖ noise
20 datafusion:vortex-file-compressed -14.2% -9.3% -5.5% +44.9% ➖ noise
20 duckdb:vortex-compact +1.9% -9.3% +12.3% +44.9% ➖ noise
20 duckdb:vortex-file-compressed -0.6% -9.3% +9.6% +44.9% ➖ noise
21 datafusion:vortex-compact -10.1% +1.7% -11.6% +44.9% ➖ noise
21 datafusion:vortex-file-compressed -20.6% +1.7% -22.0% +44.9% ➖ noise
21 duckdb:vortex-compact -3.0% +1.7% -4.7% +44.9% ➖ noise
21 duckdb:vortex-file-compressed -9.7% +1.7% -11.2% +44.9% ➖ noise
22 datafusion:vortex-compact -3.6% -16.1% +14.9% +44.9% ➖ noise
22 datafusion:vortex-file-compressed -4.8% -16.1% +13.5% +44.9% ➖ noise
22 duckdb:vortex-compact -8.7% -16.1% +8.8% +44.9% ➖ noise
22 duckdb:vortex-file-compressed -18.0% -16.1% -2.2% +45.8% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@AdamGS